[ 527.350343] env[65134]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 527.350343] env[65134]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 528.293379] env[65222]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 528.293379] env[65222]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 529.853075] env[65222]: INFO neutron.common.config [-] Logging enabled! [ 529.853075] env[65222]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev60 [ 529.853537] env[65222]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65222) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 529.853537] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 529.853537] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 529.854371] env[65222]: WARNING oslo_policy.policy [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.854595] env[65222]: WARNING oslo_policy.policy [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.856329] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] VMware NSXv3 Agent initialized successfully. [ 529.856674] env[65222]: DEBUG oslo_concurrency.lockutils [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Acquiring lock "singleton_lock" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.856830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Acquired lock "singleton_lock" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.857049] env[65222]: DEBUG oslo_concurrency.lockutils [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Releasing lock "singleton_lock" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.857349] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Full set of CONF: {{(pid=65222) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 529.857460] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ******************************************************************************** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 529.857561] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Configuration options gathered from: {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 529.857922] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 529.858137] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 529.858250] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ================================================================================ {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 529.858419] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] agent_down_time = 75 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.858558] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] allow_automatic_dhcp_failover = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.858690] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] allow_bulk = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.858830] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] api_extensions_path = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.858968] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] api_paste_config = api-paste.ini {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859119] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] auth_strategy = keystone {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859224] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] backdoor_port = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859320] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] backdoor_socket = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859451] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] backlog = 4096 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859583] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859738] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] bind_host = 0.0.0.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.859876] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] bind_port = 9696 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860020] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] client_socket_timeout = 900 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860156] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] config_dir = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860261] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860398] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] config_source = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860532] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] control_exchange = neutron {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860666] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] core_plugin = ml2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860799] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] debug = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.860935] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] default_availability_zones = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861156] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861288] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dhcp_agent_notification = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861421] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dhcp_agents_per_network = 1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861551] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dhcp_lease_duration = 86400 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861689] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dhcp_load_type = networks {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861822] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dns_domain = openstacklocal {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.861955] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862110] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_default_route_bfd = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862224] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_default_route_ecmp = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862350] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_dvr = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862476] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_new_agents = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862601] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862727] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_signals = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862852] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] enable_traditional_dhcp = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.862980] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] external_dns_driver = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863112] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] filter_validation = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863248] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] global_physnet_mtu = 8950 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863373] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] graceful_shutdown_timeout = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863542] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] host = cpu-1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863676] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] host_dvr_for_dhcp = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863805] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] http_retries = 3 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.863942] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] instance_format = [instance: %(uuid)s] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864088] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864222] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ipam_driver = internal {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864346] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ipv6_pd_enabled = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864468] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] l3_ha = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864599] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864727] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] l3_ha_network_physical_name = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.864887] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] l3_ha_network_type = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865043] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_color = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865180] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_config_append = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865313] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865438] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_dir = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865562] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_file = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865659] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_options = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865787] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_rotate_interval = 1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.865919] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_rotate_interval_type = days {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866064] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] log_rotation_type = none {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866166] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866263] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866395] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866525] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866622] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866751] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_dns_nameservers = 5 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.866904] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_header_line = 16384 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867053] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_l3_agents_per_router = 3 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867184] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_logfile_count = 30 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867310] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_logfile_size_mb = 200 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867436] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] max_subnet_host_routes = 20 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867570] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] my_ip = 10.180.1.21 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867699] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] my_ipv6 = ::1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867826] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] network_auto_schedule = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.867967] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] network_link_prefix = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868124] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868260] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] notify_nova_on_port_data_changes = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868392] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] notify_nova_on_port_status_changes = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868525] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] pagination_max_limit = -1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868651] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] publish_errors = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868776] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rate_limit_burst = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.868908] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rate_limit_except_level = CRITICAL {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869072] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rate_limit_interval = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869178] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] retry_until_window = 30 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869302] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] router_distributed = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869420] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rpc_resources_processing_step = 20 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869551] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rpc_response_max_timeout = 600 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869680] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] rpc_response_timeout = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869804] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] send_events_interval = 2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.869949] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] service_plugins = ['router'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870098] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] setproctitle = on {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870222] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] shell_completion = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870349] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] state_path = /opt/stack/data/neutron {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870480] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] syslog_log_facility = LOG_USER {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870610] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] tcp_keepidle = 600 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870741] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] transport_url = **** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.870869] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] use_journal = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871039] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] use_json = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871134] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] use_ssl = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871256] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] use_stderr = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871393] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] use_syslog = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871520] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vlan_qinq = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871646] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vlan_transparent = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871776] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] watch_log_file = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.871908] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] wsgi_default_pool_size = 100 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872050] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] wsgi_keep_alive = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872189] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872317] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] wsgi_server_debug = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.872467] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_concurrency.disable_process_locking = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.872605] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.872746] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.872878] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873022] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873161] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873292] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873438] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.connection_string = messaging:// {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873574] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.enabled = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873711] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.es_doc_type = notification {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873843] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.es_scroll_size = 10000 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.873980] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.es_scroll_time = 2m {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874125] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.filter_error_trace = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874262] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.hmac_keys = **** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874397] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.sentinel_service_name = mymaster {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874538] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.socket_timeout = 0.1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874670] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.trace_requests = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874804] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler.trace_sqlalchemy = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.874973] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler_jaeger.process_tags = {} {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.875117] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler_jaeger.service_name_prefix = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.875251] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] profiler_otlp.service_name_prefix = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.875396] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.enforce_new_defaults = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.875665] env[65222]: WARNING oslo_config.cfg [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 529.875811] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.enforce_scope = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.875954] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.policy_default_rule = default {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876113] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876253] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876393] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876524] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876652] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876777] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.876931] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877086] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877239] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877383] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] agent.extensions = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877524] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877662] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] service_providers.service_provider = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877809] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.default_quota = -1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.877995] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878157] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_floatingip = 50 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878293] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_network = 100 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878425] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_port = 500 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878554] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878684] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_router = 10 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878814] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_security_group = 10 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.878945] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879084] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.quota_subnet = 100 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879213] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] QUOTAS.track_quota_usage = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879359] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879490] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879617] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879746] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.879882] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880024] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880155] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880294] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880420] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880545] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880674] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880807] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.880937] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881074] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_dhcp_release.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881214] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881341] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881465] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881592] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881725] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881854] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.881982] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_ovs_vsctl.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882126] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.capabilities = [21] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882252] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882377] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882505] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882638] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882766] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.882892] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_namespace.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883039] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.capabilities = [12] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883168] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883293] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883422] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883556] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883686] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883811] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_conntrack.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.883945] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.capabilities = [12, 21] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884081] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.group = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884208] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.helper_command = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884336] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.log_daemon_traceback = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884467] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884596] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.thread_pool_size = 8 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884722] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] privsep_link.user = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.884895] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885063] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885203] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.continue_on_failed_promotions = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885336] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.dscp = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885472] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.dscp_inherit = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885613] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.force_mp_to_policy = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885746] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.locking_coordinator_url = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.885881] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.log_agent_heartbeats = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886024] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.logging_expire = 1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886167] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886301] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886445] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.polling_interval = 240 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886578] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886716] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.886890] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.report_interval = 30.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887057] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887202] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887343] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887480] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.sync_skew = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887614] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.synchronization_queue_size = 20 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887749] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT.use_helper_for_ns_read = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.887917] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] SECURITYGROUP.enable_ipset = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888076] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] SECURITYGROUP.enable_security_group = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888218] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888361] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888499] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] experimental.ipv6_pd_enabled = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888652] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.extension_drivers = ['port_security'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888783] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.external_network_type = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.888930] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889085] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.overlay_ip_version = 4 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889229] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.path_mtu = 8950 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889367] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.physical_network_mtus = {} {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889510] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889652] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889795] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ml2.type_drivers = ['vlan'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.889940] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890090] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890226] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890369] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890512] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890649] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890786] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.890927] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891078] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891283] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891426] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_login_password = **** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891568] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891705] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_login_user = admin {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891843] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.891985] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892132] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892264] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892404] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892545] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892684] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892822] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.892956] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893165] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893333] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893472] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893613] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893803] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.893945] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894096] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894231] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894369] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.auth_section = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894511] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.auth_type = password {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894648] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894778] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.certfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.894948] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.collect_timing = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895145] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.endpoint_type = public {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895282] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.insecure = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895411] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.keyfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895557] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.region_name = RegionOne {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895695] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.split_loggers = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895825] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] nova.timeout = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.895963] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.auth_section = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896115] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.auth_type = password {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896251] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896378] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.certfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896506] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.collect_timing = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896642] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.endpoint_type = public {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896770] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.insecure = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.896917] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.keyfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897062] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.region_name = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897192] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.split_loggers = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897318] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] placement.timeout = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897451] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.auth_section = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897579] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.auth_type = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897705] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.cafile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897849] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.certfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.897994] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.collect_timing = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898138] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.connect_retries = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898267] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.connect_retry_delay = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898399] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.enable_notifications = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898526] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.endpoint_override = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898658] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.insecure = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898787] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.interface = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.898915] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.keyfile = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899059] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.max_version = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899190] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.min_version = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899319] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.region_name = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899449] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.retriable_status_codes = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899576] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.service_name = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899705] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.service_type = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899835] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.split_loggers = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.899965] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.status_code_retries = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900102] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.status_code_retry_delay = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900233] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.timeout = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900364] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.valid_interfaces = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900492] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ironic.version = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900627] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] cli_script.dry_run = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900773] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.900906] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901049] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901182] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901311] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901440] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901568] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901697] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901825] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.901966] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902110] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902249] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902382] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902516] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902647] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902783] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.902912] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903052] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903189] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903319] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903446] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903572] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903697] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903824] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.903954] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904094] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904223] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904351] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904478] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904607] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904737] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.904896] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905056] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905192] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905327] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905458] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905588] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905727] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_notifications.driver = [] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.905861] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_notifications.retry = -1 {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906014] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906153] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.906257] env[65222]: DEBUG oslo_service.backend._eventlet.service [None req-be60516d-be36-4135-8c9d-6f7bf5edb974 None None] ******************************************************************************** {{(pid=65222) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 529.907445] env[65222]: DEBUG neutron.agent.securitygroups_rpc [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Init firewall settings (driver=nsxv3) {{(pid=65222) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 529.908758] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65222) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 529.908995] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] RPC agent_id: nsxm-l-01a.corp.local [ 529.911218] env[65222]: DEBUG dogpile.cache.region [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.911336] env[65222]: DEBUG dogpile.lock [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 529.911437] env[65222]: DEBUG dogpile.lock [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 529.911526] env[65222]: DEBUG dogpile.lock [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 529.911617] env[65222]: DEBUG dogpile.cache.region [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.911703] env[65222]: DEBUG dogpile.lock [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 529.911822] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 529.949255] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Session token - acquiring [ 529.951179] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.951363] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.951459] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.951897] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.963660] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.255501] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 530.280267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 530.280439] env[65222]: DEBUG dogpile.cache.region [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Cache value generated in 0.369 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 530.280508] env[65222]: DEBUG dogpile.lock [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 530.280634] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Activating Policy API Provider. [ 530.280824] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Looking for the default Infrastructure Rules. [ 530.375915] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Looking for the Default Layer3 Logged Drop Section. [ 530.399964] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 530.400441] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.400606] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.400720] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.401011] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.401351] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.918094] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.421188] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.924170] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Inventory metadata is going to be refreshed. [ 531.924575] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.808274] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.808590] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.808590] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.808893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.820374] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 532.822431] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.823082] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 532.842381] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.842597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.842657] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.842941] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.843078] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.843256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 532.843371] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.843476] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 532.864413] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.864654] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.864654] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.864978] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.865166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.865307] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 532.889816] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.890083] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.890131] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.890413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.890555] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.890699] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 532.913233] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.913497] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.913497] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.913784] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.913926] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.914089] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 532.914194] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.914294] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 532.938360] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.938851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.938851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.939017] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.939074] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.939267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 532.939368] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.939469] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 532.961509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.961759] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.961759] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.962084] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.962250] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.962395] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 532.962493] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.962589] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Inventory metadata have been refreshed. [ 532.962682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Dryrun:True. Metadata refresh completed. [ 532.962794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.964633] env[65222]: INFO neutron.agent.agent_extensions_manager [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Loaded agent extensions: [] [ 532.965608] env[65222]: DEBUG neutron_lib.callbacks.manager [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65222) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 533.018416] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent RPC Daemon Started! [ 533.018606] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:0 started [ 533.018606] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent out of sync with plugin! [ 537.966187] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.966462] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.967841] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.968299] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.807263] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f3449089-5a24-4cd7-bd40-bd574e680363 demo admin] Enqueued Resource ID: 201d7db8-a259-4bf1-99ff-48453e8ef4c4 with Priority: HIGHEST for action security_group_rules [ 547.807775] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201d7db8-a259-4bf1-99ff-48453e8ef4c4 with Priority: HIGHEST for action security_group_rules [ 547.808097] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201d7db8-a259-4bf1-99ff-48453e8ef4c4 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.808238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201d7db8-a259-4bf1-99ff-48453e8ef4c4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.808299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201d7db8-a259-4bf1-99ff-48453e8ef4c4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.808655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201d7db8-a259-4bf1-99ff-48453e8ef4c4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.808740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201d7db8-a259-4bf1-99ff-48453e8ef4c4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.328175] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.328497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.328497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.328640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.328733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.328827] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201d7db8-a259-4bf1-99ff-48453e8ef4c4 already deleted. [ 548.328907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201d7db8-a259-4bf1-99ff-48453e8ef4c4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.809985] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.809985] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.811359] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.811804] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.813175] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.813585] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.815067] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.816027] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.968666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.970722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.970722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.970722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.970722] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.472182] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.978424] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.481942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 571.482067] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 572.284402] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.284624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.284624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.284763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.296141] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 572.297024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.298052] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 572.317519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.317672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.317741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.317947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.318046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.318157] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 572.318226] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.318318] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 572.337968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.338121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.338188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.338415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.338530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.338648] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.359132] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.359406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.359406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.359622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.359683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.359794] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.384422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.385155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.385155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.385155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.385155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.385155] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 572.385155] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.385435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 572.404988] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.405193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.405339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.405416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.405498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.405632] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 572.405712] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.405780] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 572.428357] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.428530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.428602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.428811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.428915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.429079] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 572.429232] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.429232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 572.429342] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 572.429396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 572.429443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 572.429487] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 572.429733] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 572.429799] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 572.429852] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.454970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.455175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.455254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.455494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.455604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.455725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.479620] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.481881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.481881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.481881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.481881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.493781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.816412] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.816495] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.539475] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ace1b004-91b7-4baa-bc65-89cacade5af8 None None] Enqueued Resource ID: 168d619f-2936-458f-9094-d68150b8103f with Priority: HIGHEST for action port [ 574.539744] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168d619f-2936-458f-9094-d68150b8103f with Priority: HIGHEST for action port [ 574.540207] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-168d619f-2936-458f-9094-d68150b8103f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.540511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-168d619f-2936-458f-9094-d68150b8103f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.540511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-168d619f-2936-458f-9094-d68150b8103f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.540630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-168d619f-2936-458f-9094-d68150b8103f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.540699] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('168d619f-2936-458f-9094-d68150b8103f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.044522] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 168d619f-2936-458f-9094-d68150b8103f [ 575.044757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.044889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.044956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.045195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.045293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.045487] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:168d619f-2936-458f-9094-d68150b8103f already deleted. [ 575.045560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-168d619f-2936-458f-9094-d68150b8103f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.382296] env[65222]: INFO networking_nsxv3.common.synchronization [None req-5157e28f-f2ca-49a1-a32f-faef28ce8773 None None] Enqueued Resource ID: 6fcc3cec-756c-4ea5-832b-a6e0e6c50868 with Priority: HIGHEST for action port [ 576.382799] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fcc3cec-756c-4ea5-832b-a6e0e6c50868 with Priority: HIGHEST for action port [ 576.383109] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fcc3cec-756c-4ea5-832b-a6e0e6c50868 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.383247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fcc3cec-756c-4ea5-832b-a6e0e6c50868" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.383313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fcc3cec-756c-4ea5-832b-a6e0e6c50868" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.383556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fcc3cec-756c-4ea5-832b-a6e0e6c50868" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.383638] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fcc3cec-756c-4ea5-832b-a6e0e6c50868',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.888708] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fcc3cec-756c-4ea5-832b-a6e0e6c50868 [ 576.888708] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.888708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.888926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.889080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.889080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.889172] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fcc3cec-756c-4ea5-832b-a6e0e6c50868 already deleted. [ 576.889275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fcc3cec-756c-4ea5-832b-a6e0e6c50868" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.994341] env[65222]: INFO networking_nsxv3.common.synchronization [None req-18034c09-f3a2-4207-9a08-fe95fe937c62 None None] Enqueued Resource ID: a89050f9-85b8-46d6-80ab-1016ab6d2b50 with Priority: HIGHEST for action port [ 577.995222] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89050f9-85b8-46d6-80ab-1016ab6d2b50 with Priority: HIGHEST for action port [ 577.995947] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a89050f9-85b8-46d6-80ab-1016ab6d2b50 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.996054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a89050f9-85b8-46d6-80ab-1016ab6d2b50" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.996054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a89050f9-85b8-46d6-80ab-1016ab6d2b50" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.996314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a89050f9-85b8-46d6-80ab-1016ab6d2b50" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.996427] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89050f9-85b8-46d6-80ab-1016ab6d2b50',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.500396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a89050f9-85b8-46d6-80ab-1016ab6d2b50 [ 578.500396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.500396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.500396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.500396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.500396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.500396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a89050f9-85b8-46d6-80ab-1016ab6d2b50 already deleted. [ 578.500396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a89050f9-85b8-46d6-80ab-1016ab6d2b50" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.447346] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f1f4b347-8924-407c-aa7b-e12b8184243a None None] Enqueued Resource ID: c9d9c388-9e67-4b19-969f-a1f3fcb5d1df with Priority: HIGHEST for action port [ 579.447678] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d9c388-9e67-4b19-969f-a1f3fcb5d1df with Priority: HIGHEST for action port [ 579.448645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9d9c388-9e67-4b19-969f-a1f3fcb5d1df taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.448645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9d9c388-9e67-4b19-969f-a1f3fcb5d1df" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.448645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9d9c388-9e67-4b19-969f-a1f3fcb5d1df" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.448811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9d9c388-9e67-4b19-969f-a1f3fcb5d1df" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.448811] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9d9c388-9e67-4b19-969f-a1f3fcb5d1df',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.674911] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c8faecf8-8a76-4d7a-86d8-684932c0d691 None None] Enqueued Resource ID: 24e1e3d4-13e1-4e7d-9749-58caed4222b6 with Priority: HIGHEST for action port [ 579.675103] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24e1e3d4-13e1-4e7d-9749-58caed4222b6 with Priority: HIGHEST for action port [ 579.676176] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-24e1e3d4-13e1-4e7d-9749-58caed4222b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.676176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24e1e3d4-13e1-4e7d-9749-58caed4222b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.676176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24e1e3d4-13e1-4e7d-9749-58caed4222b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.676176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24e1e3d4-13e1-4e7d-9749-58caed4222b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.676336] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24e1e3d4-13e1-4e7d-9749-58caed4222b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.953452] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9d9c388-9e67-4b19-969f-a1f3fcb5d1df [ 579.953698] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.953832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.953903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.954263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.954361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.954460] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9d9c388-9e67-4b19-969f-a1f3fcb5d1df already deleted. [ 579.954543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9d9c388-9e67-4b19-969f-a1f3fcb5d1df" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.180889] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24e1e3d4-13e1-4e7d-9749-58caed4222b6 [ 580.181125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.181249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.181326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.181534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.181629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.181721] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24e1e3d4-13e1-4e7d-9749-58caed4222b6 already deleted. [ 580.181801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24e1e3d4-13e1-4e7d-9749-58caed4222b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.516895] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c6707df9-3dcb-4eb6-91f6-7b16aa7cf822 None None] Enqueued Resource ID: 7137a0ad-8f69-4ce7-bc25-55c83a144752 with Priority: HIGHEST for action port [ 580.516895] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7137a0ad-8f69-4ce7-bc25-55c83a144752 with Priority: HIGHEST for action port [ 580.516895] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7137a0ad-8f69-4ce7-bc25-55c83a144752 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.516895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7137a0ad-8f69-4ce7-bc25-55c83a144752" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.516895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7137a0ad-8f69-4ce7-bc25-55c83a144752" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.521264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7137a0ad-8f69-4ce7-bc25-55c83a144752" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.521264] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7137a0ad-8f69-4ce7-bc25-55c83a144752',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.023447] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7137a0ad-8f69-4ce7-bc25-55c83a144752 [ 581.023631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.023772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.023971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.024304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.024350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.024964] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7137a0ad-8f69-4ce7-bc25-55c83a144752 already deleted. [ 581.024964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7137a0ad-8f69-4ce7-bc25-55c83a144752" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.572246] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0dda503a-572b-43a5-90dd-742d358a02d1 None None] Enqueued Resource ID: f4a4a01b-3925-42ad-9270-b1174bf474d8 with Priority: HIGHEST for action port [ 581.572527] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a4a01b-3925-42ad-9270-b1174bf474d8 with Priority: HIGHEST for action port [ 581.573212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4a4a01b-3925-42ad-9270-b1174bf474d8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.573212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4a4a01b-3925-42ad-9270-b1174bf474d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.573357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4a4a01b-3925-42ad-9270-b1174bf474d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.573521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4a4a01b-3925-42ad-9270-b1174bf474d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.573729] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a4a01b-3925-42ad-9270-b1174bf474d8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.910979] env[65222]: INFO networking_nsxv3.common.synchronization [None req-13180d48-2bdf-41e0-9926-a872d9e6b42e None None] Enqueued Resource ID: 7c0382b4-e30d-43f4-be4a-53747b30be11 with Priority: HIGHEST for action port [ 581.910979] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c0382b4-e30d-43f4-be4a-53747b30be11 with Priority: HIGHEST for action port [ 581.911221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c0382b4-e30d-43f4-be4a-53747b30be11 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.911286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c0382b4-e30d-43f4-be4a-53747b30be11" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.911316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c0382b4-e30d-43f4-be4a-53747b30be11" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.911540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c0382b4-e30d-43f4-be4a-53747b30be11" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.911613] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c0382b4-e30d-43f4-be4a-53747b30be11',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.077701] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4a4a01b-3925-42ad-9270-b1174bf474d8 [ 582.077959] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.078115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.078183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.078530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.078625] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.078786] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4a4a01b-3925-42ad-9270-b1174bf474d8 already deleted. [ 582.079311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4a4a01b-3925-42ad-9270-b1174bf474d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.415763] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c0382b4-e30d-43f4-be4a-53747b30be11 [ 582.416234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.416234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.416234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.416418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.416471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.416565] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c0382b4-e30d-43f4-be4a-53747b30be11 already deleted. [ 582.416641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c0382b4-e30d-43f4-be4a-53747b30be11" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.726949] env[65222]: INFO networking_nsxv3.common.synchronization [None req-1361427a-b6af-4918-9c7f-0d3f290f45e6 None None] Enqueued Resource ID: 85c44925-f756-4511-8f4f-126b2259d2f3 with Priority: HIGHEST for action port [ 582.726949] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c44925-f756-4511-8f4f-126b2259d2f3 with Priority: HIGHEST for action port [ 582.729864] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c44925-f756-4511-8f4f-126b2259d2f3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.729864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c44925-f756-4511-8f4f-126b2259d2f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.729864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c44925-f756-4511-8f4f-126b2259d2f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.729864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c44925-f756-4511-8f4f-126b2259d2f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.729864] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c44925-f756-4511-8f4f-126b2259d2f3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.122546] env[65222]: INFO networking_nsxv3.common.synchronization [None req-82e606eb-3812-4d57-b687-e7ce22e057d4 None None] Enqueued Resource ID: 5e88cf6e-09ea-4b80-9568-f698eb12db62 with Priority: HIGHEST for action port [ 583.122775] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e88cf6e-09ea-4b80-9568-f698eb12db62 with Priority: HIGHEST for action port [ 583.123350] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e88cf6e-09ea-4b80-9568-f698eb12db62 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.123492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e88cf6e-09ea-4b80-9568-f698eb12db62" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.123610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e88cf6e-09ea-4b80-9568-f698eb12db62" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.124042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e88cf6e-09ea-4b80-9568-f698eb12db62" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.124042] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e88cf6e-09ea-4b80-9568-f698eb12db62',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.234475] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85c44925-f756-4511-8f4f-126b2259d2f3 [ 583.234475] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.234475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.234475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.234475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.234475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.234475] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85c44925-f756-4511-8f4f-126b2259d2f3 already deleted. [ 583.234475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c44925-f756-4511-8f4f-126b2259d2f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.626278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e88cf6e-09ea-4b80-9568-f698eb12db62 [ 583.626526] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.626733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.626788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.626963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.627064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.627166] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e88cf6e-09ea-4b80-9568-f698eb12db62 already deleted. [ 583.627249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e88cf6e-09ea-4b80-9568-f698eb12db62" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.491930] env[65222]: INFO networking_nsxv3.common.synchronization [None req-7cb32adc-af6e-4a34-92e6-1e9e19b0acca None None] Enqueued Resource ID: fe338089-3ff0-4454-9774-527c19541a69 with Priority: HIGHEST for action port [ 584.491930] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe338089-3ff0-4454-9774-527c19541a69 with Priority: HIGHEST for action port [ 584.492348] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe338089-3ff0-4454-9774-527c19541a69 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.492348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe338089-3ff0-4454-9774-527c19541a69" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.492348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe338089-3ff0-4454-9774-527c19541a69" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.492481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe338089-3ff0-4454-9774-527c19541a69" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.493042] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe338089-3ff0-4454-9774-527c19541a69',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.997694] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe338089-3ff0-4454-9774-527c19541a69 [ 584.997929] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.998072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.998151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.998811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.998911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.999018] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe338089-3ff0-4454-9774-527c19541a69 already deleted. [ 584.999106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe338089-3ff0-4454-9774-527c19541a69" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.187335] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4ce025be-5058-4812-baed-04c9372d2228 None None] Enqueued Resource ID: 0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256 with Priority: HIGHEST for action port [ 585.188564] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256 with Priority: HIGHEST for action port [ 585.188564] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.188564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.189105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.189551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.189765] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.692228] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256 [ 585.692642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.692742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.692742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.693885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.693885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.693885] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256 already deleted. [ 585.693885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9bc5ae-9d17-43e8-9a38-63a9b9eaa256" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.746058] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d64b7551-9736-43af-ad93-54d3c9f7c5ea tempest-ServersTestBootFromVolume-1606057182 tempest-ServersTestBootFromVolume-1606057182-project-member] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 586.746692] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 586.746973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.748255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.748310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.748596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.748653] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.865298] env[65222]: INFO networking_nsxv3.common.synchronization [None req-219bfca8-340b-4768-8b65-06584e755223 tempest-ServersTestBootFromVolume-1606057182 tempest-ServersTestBootFromVolume-1606057182-project-member] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 586.866256] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 586.866560] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.866560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.968166] env[65222]: INFO networking_nsxv3.common.synchronization [None req-45f5e015-783a-4c1c-b86d-c3cfb16ecd2e None None] Enqueued Resource ID: c142f629-7c07-46cc-bfff-cf9e920cd861 with Priority: HIGHEST for action port [ 586.969367] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c142f629-7c07-46cc-bfff-cf9e920cd861 with Priority: HIGHEST for action port [ 586.969367] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c142f629-7c07-46cc-bfff-cf9e920cd861 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.969367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c142f629-7c07-46cc-bfff-cf9e920cd861" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.969367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c142f629-7c07-46cc-bfff-cf9e920cd861" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.969555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c142f629-7c07-46cc-bfff-cf9e920cd861" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.969555] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c142f629-7c07-46cc-bfff-cf9e920cd861',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.205439] env[65222]: INFO networking_nsxv3.common.synchronization [None req-81a9d0b5-6a2b-4e37-ab48-10c0d3f92b5f None None] Enqueued Resource ID: 112b8312-4955-4fc9-b07c-d238dbccc403 with Priority: HIGHEST for action port [ 587.206055] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112b8312-4955-4fc9-b07c-d238dbccc403 with Priority: HIGHEST for action port [ 587.206266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-112b8312-4955-4fc9-b07c-d238dbccc403 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.206474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112b8312-4955-4fc9-b07c-d238dbccc403" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.206546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112b8312-4955-4fc9-b07c-d238dbccc403" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.206772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112b8312-4955-4fc9-b07c-d238dbccc403" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.206853] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112b8312-4955-4fc9-b07c-d238dbccc403',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.271227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.271660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.271660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.271898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.272049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.272658] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db already deleted. [ 587.272658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.272904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.273505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.273505] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.472409] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c142f629-7c07-46cc-bfff-cf9e920cd861 [ 587.473027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.473027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.473027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.473251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.473251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.473325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c142f629-7c07-46cc-bfff-cf9e920cd861 already deleted. [ 587.473357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c142f629-7c07-46cc-bfff-cf9e920cd861" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.711175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 112b8312-4955-4fc9-b07c-d238dbccc403 [ 587.711175] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.711175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.711175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.711175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.711175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.711175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:112b8312-4955-4fc9-b07c-d238dbccc403 already deleted. [ 587.711175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112b8312-4955-4fc9-b07c-d238dbccc403" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.760022] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4b7c204e-97ca-48ae-b726-d70631a30cbb tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 587.760022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 587.760022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.760022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.760022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.760022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.760022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.796531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.796531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.796531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.796531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.796531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.796531] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db already deleted. [ 587.796531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.862934] env[65222]: INFO networking_nsxv3.common.synchronization [None req-bcddd7cd-3a12-4201-ad91-dddfe16410c3 None None] Enqueued Resource ID: 44c454e5-2bc5-4ab5-8627-e8d32aa5f758 with Priority: HIGHEST for action port [ 587.863496] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c454e5-2bc5-4ab5-8627-e8d32aa5f758 with Priority: HIGHEST for action port [ 587.863905] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-44c454e5-2bc5-4ab5-8627-e8d32aa5f758 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.864052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44c454e5-2bc5-4ab5-8627-e8d32aa5f758" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.864052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44c454e5-2bc5-4ab5-8627-e8d32aa5f758" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.866652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44c454e5-2bc5-4ab5-8627-e8d32aa5f758" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.866652] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44c454e5-2bc5-4ab5-8627-e8d32aa5f758',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.037121] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0699d5c8-e3bc-4b3d-9df7-707e4bebfa14 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 588.037278] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 588.037621] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.037621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.285138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.285310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.285357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.285602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.285673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.285777] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c already deleted. [ 588.285904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.286031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.286190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.286274] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.370710] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44c454e5-2bc5-4ab5-8627-e8d32aa5f758 [ 588.371815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.371815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.371815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.371815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.371815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.371815] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44c454e5-2bc5-4ab5-8627-e8d32aa5f758 already deleted. [ 588.371815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44c454e5-2bc5-4ab5-8627-e8d32aa5f758" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.813751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.814044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.814044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.814348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.814523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.814651] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c already deleted. [ 588.814862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.071642] env[65222]: INFO networking_nsxv3.common.synchronization [None req-43f33d42-f747-47be-9685-6789c7abeac3 None None] Enqueued Resource ID: e04b9de8-91c3-4f8b-9d7e-e506c39e02d5 with Priority: HIGHEST for action port [ 589.072158] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b9de8-91c3-4f8b-9d7e-e506c39e02d5 with Priority: HIGHEST for action port [ 589.073908] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04b9de8-91c3-4f8b-9d7e-e506c39e02d5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.073908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04b9de8-91c3-4f8b-9d7e-e506c39e02d5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.073908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04b9de8-91c3-4f8b-9d7e-e506c39e02d5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.074491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04b9de8-91c3-4f8b-9d7e-e506c39e02d5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.074491] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04b9de8-91c3-4f8b-9d7e-e506c39e02d5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.577424] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e04b9de8-91c3-4f8b-9d7e-e506c39e02d5 [ 589.577632] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.577705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.577740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.577959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.578108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.578172] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e04b9de8-91c3-4f8b-9d7e-e506c39e02d5 already deleted. [ 589.578250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04b9de8-91c3-4f8b-9d7e-e506c39e02d5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.159603] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2996710e-5e5c-4d3c-aa06-75cf5f1955ba None None] Enqueued Resource ID: 61747fc0-33f8-4b1d-8611-7e835d938b1b with Priority: HIGHEST for action port [ 591.163421] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61747fc0-33f8-4b1d-8611-7e835d938b1b with Priority: HIGHEST for action port [ 591.163421] env[65222]: INFO networking_nsxv3.common.synchronization [req-6b54c13b-1392-4601-93e6-3bab94d735b0 req-a51e701b-8db5-4bc9-beae-f9335942d7ba tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 591.164140] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-61747fc0-33f8-4b1d-8611-7e835d938b1b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.164268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61747fc0-33f8-4b1d-8611-7e835d938b1b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.164334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61747fc0-33f8-4b1d-8611-7e835d938b1b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.164604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61747fc0-33f8-4b1d-8611-7e835d938b1b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.164678] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61747fc0-33f8-4b1d-8611-7e835d938b1b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.165856] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 591.169535] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.169535] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.169535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.169535] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.454194] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2cb4feca-99fa-43de-889a-74f52a77cce2 None None] Enqueued Resource ID: 68671239-569b-4557-bdd1-93f6a939835f with Priority: HIGHEST for action port [ 591.454194] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68671239-569b-4557-bdd1-93f6a939835f with Priority: HIGHEST for action port [ 591.458334] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-68671239-569b-4557-bdd1-93f6a939835f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.458334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68671239-569b-4557-bdd1-93f6a939835f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.458334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68671239-569b-4557-bdd1-93f6a939835f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.458334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68671239-569b-4557-bdd1-93f6a939835f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.459334] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68671239-569b-4557-bdd1-93f6a939835f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.671654] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61747fc0-33f8-4b1d-8611-7e835d938b1b [ 591.671994] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.672186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.672827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.672827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.672827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.672827] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61747fc0-33f8-4b1d-8611-7e835d938b1b already deleted. [ 591.672987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61747fc0-33f8-4b1d-8611-7e835d938b1b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.682868] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.683020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.683020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.683520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.683520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.683520] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.683704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.683704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.683879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.683922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.683980] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a already deleted. [ 591.684076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.965012] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68671239-569b-4557-bdd1-93f6a939835f [ 591.965012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.965269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.965269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.965638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.965638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.967908] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68671239-569b-4557-bdd1-93f6a939835f already deleted. [ 591.967908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68671239-569b-4557-bdd1-93f6a939835f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.322988] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.323396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.323396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.323669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.323933] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.324471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.324614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.324931] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.325125] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.325426] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.325568] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.325661] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.325770] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.325880] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.325990] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.326131] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.358104] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.358104] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.358104] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.358104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.358104] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-55724a8c-b19e-456f-a467-e5e0e287b789 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.358104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.358104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.358104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.358104] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55724a8c-b19e-456f-a467-e5e0e287b789',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.861995] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.862250] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.862431] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.862632] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.862781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.863018] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 55724a8c-b19e-456f-a467-e5e0e287b789 not found, creating... [ 592.863287] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.863368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.864088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.864088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.864088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.864209] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.864366] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.864450] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.869049] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.869049] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.869049] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 55724a8c-b19e-456f-a467-e5e0e287b789 is going to be created. [ 592.895724] env[65222]: INFO networking_nsxv3.common.synchronization [req-10f3c429-dc60-4ebd-91d5-aaac3169d586 req-57dce139-5984-45a5-8c7b-994ec2fdc878 tempest-DeleteServersAdminTestJSON-1564260038 tempest-DeleteServersAdminTestJSON-1564260038-project-member] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 592.896912] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.897109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.900240] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.900520] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.900520] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.900783] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.902127] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 592.903028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.903028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.903172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.903349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.903515] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.903914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.903914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.904421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.904549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.904654] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.408078] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.408494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.408494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.408702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.408702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.409021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.409021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.409021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.409763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.409921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.410222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 already deleted. [ 593.410222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.664767] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.665045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.665160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.665552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.666426] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.666750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.666920] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.668411] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.668411] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.668411] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.668411] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.668411] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.668411] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.668411] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.668411] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.668411] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.688636] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.688636] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.688636] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.688636] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.688912] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-138b4726-e1c3-4ddb-a0aa-67a920eb944a taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.688912] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.689025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.689342] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.689474] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138b4726-e1c3-4ddb-a0aa-67a920eb944a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.710674] env[65222]: INFO networking_nsxv3.common.synchronization [req-6b54c13b-1392-4601-93e6-3bab94d735b0 req-9c172b8e-d2f6-48d8-bea9-f143dd106a8d service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 593.710854] env[65222]: INFO networking_nsxv3.common.synchronization [req-6b54c13b-1392-4601-93e6-3bab94d735b0 req-9c172b8e-d2f6-48d8-bea9-f143dd106a8d service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 593.710985] env[65222]: INFO networking_nsxv3.common.synchronization [req-6b54c13b-1392-4601-93e6-3bab94d735b0 req-9c172b8e-d2f6-48d8-bea9-f143dd106a8d service nova] Enqueued Resource ID: 55724a8c-b19e-456f-a467-e5e0e287b789 with Priority: HIGHEST for action port [ 593.711440] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 593.711575] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 593.711844] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55724a8c-b19e-456f-a467-e5e0e287b789 with Priority: HIGHEST for action port [ 593.711923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.712050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.712121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.712353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.712434] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.713304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.713395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.713496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.713610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.713753] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.713871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.713930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.714041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.714125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.714215] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.714893] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-55724a8c-b19e-456f-a467-e5e0e287b789 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.715205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.715205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.715205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.715322] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55724a8c-b19e-456f-a467-e5e0e287b789',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.192420] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.193763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.193763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.193763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.193763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.193763] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 138b4726-e1c3-4ddb-a0aa-67a920eb944a not found, creating... [ 594.193763] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.193763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.194089] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.194089] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.194152] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.195708] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.195708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.195708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.195708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.195708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.195708] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 138b4726-e1c3-4ddb-a0aa-67a920eb944a is going to be created. [ 594.220242] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.220459] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.220576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.221596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.222400] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.222649] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.223581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.223685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.223857] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.232691] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55724a8c-b19e-456f-a467-e5e0e287b789 with status ACTIVE [ 594.232874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.233022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.233092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.233311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.233407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.233655] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.233708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.233792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.233879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.233958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.234162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.234267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.234384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.234557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.234557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.234615] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55724a8c-b19e-456f-a467-e5e0e287b789 is going to be updated. [ 594.263941] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.264163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.264163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.264409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.265104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.265378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55724a8c-b19e-456f-a467-e5e0e287b789" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.507144] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b2a046cf-d9b9-436d-b822-65e451b76e2b None None] Enqueued Resource ID: b812b5ad-03c8-4dcb-99dd-68fd18fe8554 with Priority: HIGHEST for action port [ 594.507958] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b812b5ad-03c8-4dcb-99dd-68fd18fe8554 with Priority: HIGHEST for action port [ 594.508076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b812b5ad-03c8-4dcb-99dd-68fd18fe8554 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.508198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b812b5ad-03c8-4dcb-99dd-68fd18fe8554" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.508372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b812b5ad-03c8-4dcb-99dd-68fd18fe8554" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.508732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b812b5ad-03c8-4dcb-99dd-68fd18fe8554" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.508812] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b812b5ad-03c8-4dcb-99dd-68fd18fe8554',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.527987] env[65222]: INFO networking_nsxv3.common.synchronization [None req-073b68ff-46ef-432e-a0f5-280a27ae2b58 None None] Enqueued Resource ID: 43da0662-5ad8-4b08-ab74-0b22270b0103 with Priority: HIGHEST for action port [ 594.529300] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43da0662-5ad8-4b08-ab74-0b22270b0103 with Priority: HIGHEST for action port [ 594.529300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-43da0662-5ad8-4b08-ab74-0b22270b0103 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.529446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43da0662-5ad8-4b08-ab74-0b22270b0103" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.529446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43da0662-5ad8-4b08-ab74-0b22270b0103" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.529643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43da0662-5ad8-4b08-ab74-0b22270b0103" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.529723] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43da0662-5ad8-4b08-ab74-0b22270b0103',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.619080] env[65222]: INFO networking_nsxv3.common.synchronization [req-a725d07c-c20c-4d61-8e51-470257545966 req-18b7661b-3423-4474-b401-57e76a77d2d3 tempest-ServerDiagnosticsNegativeTest-470585762 tempest-ServerDiagnosticsNegativeTest-470585762-project-member] Enqueued Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 594.619080] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 594.619908] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.619908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.619908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.620372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.620901] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.620901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.620901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.621092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.621180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.621277] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.725467] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.011017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b812b5ad-03c8-4dcb-99dd-68fd18fe8554 [ 595.011017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.011192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.011269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.011475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.011621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.011655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b812b5ad-03c8-4dcb-99dd-68fd18fe8554 already deleted. [ 595.011760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b812b5ad-03c8-4dcb-99dd-68fd18fe8554" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.033856] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43da0662-5ad8-4b08-ab74-0b22270b0103 [ 595.033856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.033856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.033856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.033856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.033856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.033856] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43da0662-5ad8-4b08-ab74-0b22270b0103 already deleted. [ 595.033856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43da0662-5ad8-4b08-ab74-0b22270b0103" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.084039] env[65222]: INFO networking_nsxv3.common.synchronization [req-10f3c429-dc60-4ebd-91d5-aaac3169d586 req-9301112c-9760-4c57-8803-a277bffbcd2e service nova] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_rules [ 595.084207] env[65222]: INFO networking_nsxv3.common.synchronization [req-10f3c429-dc60-4ebd-91d5-aaac3169d586 req-9301112c-9760-4c57-8803-a277bffbcd2e service nova] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 595.084332] env[65222]: INFO networking_nsxv3.common.synchronization [req-10f3c429-dc60-4ebd-91d5-aaac3169d586 req-9301112c-9760-4c57-8803-a277bffbcd2e service nova] Enqueued Resource ID: 138b4726-e1c3-4ddb-a0aa-67a920eb944a with Priority: HIGHEST for action port [ 595.084557] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_rules [ 595.084876] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 595.084876] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 138b4726-e1c3-4ddb-a0aa-67a920eb944a with Priority: HIGHEST for action port [ 595.086471] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.086471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.086471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.086471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.086471] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.088192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.088192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.088192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.088192] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.089662] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-138b4726-e1c3-4ddb-a0aa-67a920eb944a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.090654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.092335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.092335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.092447] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138b4726-e1c3-4ddb-a0aa-67a920eb944a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.123931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.124109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.124209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.124382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.124472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.124695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.124805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.124891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.125078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.125165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.125252] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d already deleted. [ 595.125332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.228302] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.228497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.228530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.229550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.229612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.229773] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be created. [ 595.261202] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.261781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.262152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.263936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.263936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.275311] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: UNINITIALIZED for 2s [ 595.411454] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.412046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.412046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.412046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.412255] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.412404] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.412512] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.412720] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.412858] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.413075] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.413226] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.413323] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.413410] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.413510] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.413608] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.413732] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.434611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.434776] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.434911] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.435089] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.435397] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-9bfff68c-5dfc-4c4a-b139-f867712c50b9 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.435579] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.435714] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.436097] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.436275] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfff68c-5dfc-4c4a-b139-f867712c50b9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.541181] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2c40b048-f8ee-45c6-94b8-35e1a2448e52 tempest-VolumesAssistedSnapshotsTest-1127806725 tempest-VolumesAssistedSnapshotsTest-1127806725-project-member] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 595.541181] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 595.541909] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.542214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.542403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.542765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.543394] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.594844] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.594844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.594844] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.596145] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 138b4726-e1c3-4ddb-a0aa-67a920eb944a with status ACTIVE [ 595.596366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.596505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.596583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.596815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.596929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.599040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.599040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.599040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.599040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.599040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.599040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.599341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.599341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.599341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.599436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.599505] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 138b4726-e1c3-4ddb-a0aa-67a920eb944a is going to be updated. [ 595.621854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.621854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.621854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.621854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.621854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.621854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-138b4726-e1c3-4ddb-a0aa-67a920eb944a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.749024] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ac92b2fa-44f0-45b6-acf2-1d4df7d8131e tempest-ServersV294TestFqdnHostnames-1538117571 tempest-ServersV294TestFqdnHostnames-1538117571-project-member] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 595.749024] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 595.749561] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.749561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.749561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.749803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.749861] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.938481] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.938755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.938889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.939180] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.939428] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.939475] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 9bfff68c-5dfc-4c4a-b139-f867712c50b9 not found, creating... [ 595.939737] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.939885] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.939996] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.940218] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.940347] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.940620] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.940859] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.940919] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.941419] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.941596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.941753] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 9bfff68c-5dfc-4c4a-b139-f867712c50b9 is going to be created. [ 595.945269] env[65222]: INFO networking_nsxv3.common.synchronization [None req-5b2b6d5a-90da-4b57-a805-9b915af3e952 tempest-VolumesAssistedSnapshotsTest-1127806725 tempest-VolumesAssistedSnapshotsTest-1127806725-project-member] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 595.945591] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 595.946083] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.946174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.966194] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.966401] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.966521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.966779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.966997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.967233] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.062223] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.062223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.062487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.062487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.062606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.062680] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 already deleted. [ 596.062763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.062933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.063417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.063417] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.101809] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.175517] env[65222]: INFO networking_nsxv3.common.synchronization [None req-430cf10c-7bbd-4e79-a609-04d366c6f66c tempest-ServersV294TestFqdnHostnames-1538117571 tempest-ServersV294TestFqdnHostnames-1538117571-project-member] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 596.176252] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 596.176612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.177076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.273069] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.273306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.273397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.273658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.273786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.273973] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 already deleted. [ 596.274088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.274473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.274690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.274781] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.587206] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.587535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.587535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.587659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.587756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.587854] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 already deleted. [ 596.587934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.603518] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.603988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.603988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.603988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.604145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.604145] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be created. [ 596.627742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.627813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.627844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.628100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.628253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.639511] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: UNINITIALIZED for 2s [ 596.712156] env[65222]: INFO networking_nsxv3.common.synchronization [req-a725d07c-c20c-4d61-8e51-470257545966 req-d3c38067-bec3-48ed-950a-de2e36dc07a1 service nova] Enqueued Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_rules [ 596.712209] env[65222]: INFO networking_nsxv3.common.synchronization [req-a725d07c-c20c-4d61-8e51-470257545966 req-d3c38067-bec3-48ed-950a-de2e36dc07a1 service nova] Enqueued Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 596.712322] env[65222]: INFO networking_nsxv3.common.synchronization [req-a725d07c-c20c-4d61-8e51-470257545966 req-d3c38067-bec3-48ed-950a-de2e36dc07a1 service nova] Enqueued Resource ID: 9bfff68c-5dfc-4c4a-b139-f867712c50b9 with Priority: HIGHEST for action port [ 596.712801] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_rules [ 596.712935] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 596.714198] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfff68c-5dfc-4c4a-b139-f867712c50b9 with Priority: HIGHEST for action port [ 596.716297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.716297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.716455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.716789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.716789] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.721096] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.721197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.721260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.721453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.721639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.721769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.721769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.721905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.721991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.722093] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.722896] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bfff68c-5dfc-4c4a-b139-f867712c50b9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.723029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.723072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.723228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.723302] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfff68c-5dfc-4c4a-b139-f867712c50b9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.798084] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.798296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.798373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.798715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.798933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.798970] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 already deleted. [ 596.799085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.225240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.225410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.225584] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.226440] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bfff68c-5dfc-4c4a-b139-f867712c50b9 with status ACTIVE [ 597.226631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.226745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.226798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.227018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.227140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.227306] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.227417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.227493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.227645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.227733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.227900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.228038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.229052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.229263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.229960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.229960] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bfff68c-5dfc-4c4a-b139-f867712c50b9 is going to be updated. [ 597.254268] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.254268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.254268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.254268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.254622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.254622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bfff68c-5dfc-4c4a-b139-f867712c50b9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.295271] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 597.296216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.296216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.296216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.296514] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.296610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.296648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.296851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.296939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.298219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.298397] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.595262] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7cb8193-dc28-4700-ac19-548379f9e781 req-4d51d1b7-ae2f-4a71-bb52-87dad4f141d2 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 597.595786] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 597.596095] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.596235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.596312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.596570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.596728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.597714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.597803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.597972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.598082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.598177] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.734185] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.803166] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803166] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803166] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.803166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.803748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.803748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.803748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803952] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.977023] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.977023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.977023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.977023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.977023] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.978191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.978291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.978560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.978785] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.979101] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.979226] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.979333] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.979436] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.979811] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.979811] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.979811] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.004576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.004576] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.004576] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.004576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.004576] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-c31be9f6-812c-41a3-95f9-eeab940d72bc taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.004576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.004576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.004576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.004576] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c31be9f6-812c-41a3-95f9-eeab940d72bc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.101957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.101957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.101957] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 already deleted. [ 598.101957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236502] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.236502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.236502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.236502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.236502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236502] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d is going to be created. [ 598.260856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.261517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.261517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.261517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.261517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.272657] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: UNINITIALIZED for 2s [ 598.308520] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bedc55f5-0ad2-4b84-aab1-d26ca6737e7a: rpc.has_security_group_logging(os_id): False [ 598.332442] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.332592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.332673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.332942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.333083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.333290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.333379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.333411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.333573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.334358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.334358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.334358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.334358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.334358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.334358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.334621] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.334621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.334621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.334730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.334759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.334843] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be created. [ 598.406019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.406019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.406019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.406019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.406019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.417352] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 598.508190] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.508414] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.508546] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.508869] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.509061] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.509241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port c31be9f6-812c-41a3-95f9-eeab940d72bc not found, creating... [ 598.509533] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.509711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.509847] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.510168] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.510309] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.510666] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.510850] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.510965] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.511231] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.511377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.511528] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: c31be9f6-812c-41a3-95f9-eeab940d72bc is going to be created. [ 598.549614] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.549825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.549954] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.550314] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.550557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.550804] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.650302] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 598.650302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.650302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.650807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.650807] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.650938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.651034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.651241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.651329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.651415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.651509] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.154186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.157022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.157022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.157022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.157022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.157838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.157838] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.312684] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7cb8193-dc28-4700-ac19-548379f9e781 req-db8f8d45-d46b-401d-b3ca-373844b26991 service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 599.312886] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7cb8193-dc28-4700-ac19-548379f9e781 req-db8f8d45-d46b-401d-b3ca-373844b26991 service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 599.313033] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7cb8193-dc28-4700-ac19-548379f9e781 req-db8f8d45-d46b-401d-b3ca-373844b26991 service nova] Enqueued Resource ID: c31be9f6-812c-41a3-95f9-eeab940d72bc with Priority: HIGHEST for action port [ 599.313608] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 599.313724] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 599.313861] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31be9f6-812c-41a3-95f9-eeab940d72bc with Priority: HIGHEST for action port [ 599.314389] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.314507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.314574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.314833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.314919] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.315856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.316057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.316177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.316439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.316648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.316782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.316904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.317099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.317202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.317323] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.318214] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c31be9f6-812c-41a3-95f9-eeab940d72bc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.318323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.318378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.318533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.318624] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c31be9f6-812c-41a3-95f9-eeab940d72bc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.664441] env[65222]: INFO networking_nsxv3.common.synchronization [req-169ec9d2-45e0-49c3-bbb7-8b259c42ef72 req-225b9a58-17f4-4aa8-8e7f-d9598dabc926 tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 599.665017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53a4a97d-b980-4164-9506-aae26c06b4c1: rpc.has_security_group_logging(os_id): False [ 599.666846] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 599.667300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.667699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.667811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.668192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.668399] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.668505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.668579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.668938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.669062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.669172] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.693027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.693300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.693372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.693583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.693691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.694116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.694176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.694296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.694504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.694621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.694845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.694948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.695418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.695623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.695705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.695913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.696030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.696095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.696240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.696317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.696403] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be created. [ 599.760457] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.760457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.760457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.760457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.760457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.787334] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 599.820071] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.820200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.820833] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.822073] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c31be9f6-812c-41a3-95f9-eeab940d72bc with status ACTIVE [ 599.822073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.822073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.822073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.822073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.822073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.822073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.822355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.822355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.822355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.822437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.823150] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.823150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.823150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.823150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.823150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.826843] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c31be9f6-812c-41a3-95f9-eeab940d72bc is going to be updated. [ 599.861756] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.861756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.861756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.861756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.861756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.861756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c31be9f6-812c-41a3-95f9-eeab940d72bc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.995187] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.995378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.995513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.995755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.996012] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.996265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.996419] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.996645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.996851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.997088] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.997224] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.997387] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.997464] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.997757] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.997757] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.997945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.017920] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.018155] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.018335] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.018544] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.018909] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-fb4d4a8b-47f1-45c4-8885-b87955c63475 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.019134] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.019290] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.019643] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.019806] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4d4a8b-47f1-45c4-8885-b87955c63475',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.171754] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.172019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.172113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.172344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.172472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.172812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.172909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.172961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.173127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.173207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.173343] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 already deleted. [ 600.173413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.288181] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: SUCCESS [ 600.288181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.288181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.288458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.288882] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.289219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.289219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.289454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.289513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.289610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.289685] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.329231] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.438665] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 600.439020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.489073] env[65222]: INFO networking_nsxv3.common.synchronization [None req-daecb98f-38e0-4c2f-9664-e654b2fd4e5e None None] Enqueued Resource ID: 6d14bda8-4ed2-4cc2-bbd4-e39ff805260f with Priority: HIGHEST for action port [ 600.489958] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d14bda8-4ed2-4cc2-bbd4-e39ff805260f with Priority: HIGHEST for action port [ 600.489958] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d14bda8-4ed2-4cc2-bbd4-e39ff805260f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.490091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d14bda8-4ed2-4cc2-bbd4-e39ff805260f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.490187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d14bda8-4ed2-4cc2-bbd4-e39ff805260f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.490484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d14bda8-4ed2-4cc2-bbd4-e39ff805260f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.490603] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d14bda8-4ed2-4cc2-bbd4-e39ff805260f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.522652] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.522876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.523018] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.523374] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.523546] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.523712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port fb4d4a8b-47f1-45c4-8885-b87955c63475 not found, creating... [ 600.523984] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.524178] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.524300] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.524538] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.524684] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.524989] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.525166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.525276] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.525499] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.525626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.525758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: fb4d4a8b-47f1-45c4-8885-b87955c63475 is going to be created. [ 600.551273] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.551513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.551656] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.552052] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.552398] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.553283] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.793271] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.793655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.793655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.793726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.793857] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.794028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.794028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.794175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.794265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.794351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.795323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.795442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.795966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.795966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.795966] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.796141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.796141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.796278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.796354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.796424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.796608] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.834312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.834312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.834312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.834312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.834312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.834312] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be created. [ 600.861329] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.861329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.861489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.861665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.861849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.872462] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: UNINITIALIZED for 2s [ 600.993163] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d14bda8-4ed2-4cc2-bbd4-e39ff805260f [ 600.993578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.993869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.994049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.994342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.994679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.995094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d14bda8-4ed2-4cc2-bbd4-e39ff805260f already deleted. [ 600.995262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d14bda8-4ed2-4cc2-bbd4-e39ff805260f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.285253] env[65222]: INFO networking_nsxv3.common.synchronization [req-169ec9d2-45e0-49c3-bbb7-8b259c42ef72 req-c3da6993-1270-47d1-9765-a80ea513ce0f service nova] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_rules [ 601.285504] env[65222]: INFO networking_nsxv3.common.synchronization [req-169ec9d2-45e0-49c3-bbb7-8b259c42ef72 req-c3da6993-1270-47d1-9765-a80ea513ce0f service nova] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 601.285706] env[65222]: INFO networking_nsxv3.common.synchronization [req-169ec9d2-45e0-49c3-bbb7-8b259c42ef72 req-c3da6993-1270-47d1-9765-a80ea513ce0f service nova] Enqueued Resource ID: fb4d4a8b-47f1-45c4-8885-b87955c63475 with Priority: HIGHEST for action port [ 601.288883] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_rules [ 601.288883] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 601.288883] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb4d4a8b-47f1-45c4-8885-b87955c63475 with Priority: HIGHEST for action port [ 601.288883] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.288883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.289290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.290270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.290270] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.291268] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.291424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.291513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.291715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.291914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.292069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.292137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.292294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.293038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.293038] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.295540] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb4d4a8b-47f1-45c4-8885-b87955c63475 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.295737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.295815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.297331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.297331] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4d4a8b-47f1-45c4-8885-b87955c63475',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.298839] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c1005d5-d839-41cb-b881-ed288aaf593d: rpc.has_security_group_logging(os_id): False [ 601.319303] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.319481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.319551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.319895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.320045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.320324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.320434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.320510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.320709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.320800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.321459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.322516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.322516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.323480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.323480] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d is going to be created. [ 601.390665] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.390903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.390903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.391079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.392054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.410790] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: IN_PROGRESS for 2s [ 601.484517] env[65222]: INFO networking_nsxv3.common.synchronization [req-8e47d5ce-518f-4a1c-b10e-3f0d71e311b2 req-110da9c8-e711-42eb-bc76-aa1b1ff13a4d tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 601.485065] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 601.486503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.486711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.486820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.487137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.487381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.487542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.487699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.487935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.488083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.488604] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.793125] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-239" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-239" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-239" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.796495] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.796495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.796495] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.796495] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.796495] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.797568] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.797817] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.797888] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.797992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.802028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.802182] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.802253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.802524] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb4d4a8b-47f1-45c4-8885-b87955c63475 with status ACTIVE [ 601.802701] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.804339] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.804339] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.804339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.804812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.804812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.804812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.804812] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb4d4a8b-47f1-45c4-8885-b87955c63475 is going to be updated. [ 601.825722] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 601.826307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.835409] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.835574] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.835709] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.835883] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-239" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.836216] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b82d1fa3-c300-40f8-9317-540c277089c0 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.836389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.836502] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.836837] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.836975] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82d1fa3-c300-40f8-9317-540c277089c0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.839634] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.839782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.839840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.840087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.840176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.840339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb4d4a8b-47f1-45c4-8885-b87955c63475" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.991890] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.991890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.991890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.991890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.992179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.992452] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.992575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.992665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.993554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.993554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.993554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c already deleted. [ 601.993554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.308822] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.338933] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.339877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.339877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.339877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.339877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.339877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b82d1fa3-c300-40f8-9317-540c277089c0 not found, creating... [ 602.340102] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.340260] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.340368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.340578] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.340701] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.340964] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.341122] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.341230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.341427] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.341547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.341687] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b82d1fa3-c300-40f8-9317-540c277089c0 is going to be created. [ 602.365744] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.366224] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.366224] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.366501] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.366764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.367030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.637275] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ffa2b2fb-cd9a-47cf-96f3-d68a3118b9b9 None None] Enqueued Resource ID: 790ab134-3d29-4883-b0bd-e2abce1fad9e with Priority: HIGHEST for action port [ 602.638102] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790ab134-3d29-4883-b0bd-e2abce1fad9e with Priority: HIGHEST for action port [ 602.638479] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-790ab134-3d29-4883-b0bd-e2abce1fad9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.638657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-790ab134-3d29-4883-b0bd-e2abce1fad9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.638779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-790ab134-3d29-4883-b0bd-e2abce1fad9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.639168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-790ab134-3d29-4883-b0bd-e2abce1fad9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.639311] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('790ab134-3d29-4883-b0bd-e2abce1fad9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.811168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.811168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.811168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.811627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.811627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.811627] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be created. [ 602.835710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.835710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.836166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.836166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.836238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.847455] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: UNINITIALIZED for 2s [ 602.882642] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 602.882642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.882642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.882642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.882642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.882642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.882642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.883498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.883498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.883498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.883498] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.083637] env[65222]: INFO networking_nsxv3.common.synchronization [req-8e47d5ce-518f-4a1c-b10e-3f0d71e311b2 req-e367cdf5-4a27-4657-8d78-2bef9699d760 service nova] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 603.084663] env[65222]: INFO networking_nsxv3.common.synchronization [req-8e47d5ce-518f-4a1c-b10e-3f0d71e311b2 req-e367cdf5-4a27-4657-8d78-2bef9699d760 service nova] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 603.085863] env[65222]: INFO networking_nsxv3.common.synchronization [req-8e47d5ce-518f-4a1c-b10e-3f0d71e311b2 req-e367cdf5-4a27-4657-8d78-2bef9699d760 service nova] Enqueued Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 603.086148] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 603.086282] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 603.086379] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 603.086938] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.088589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.088589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.088589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.088589] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.093790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.093790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.093790] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.093790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b82d1fa3-c300-40f8-9317-540c277089c0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.093790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.093790] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82d1fa3-c300-40f8-9317-540c277089c0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.141368] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 790ab134-3d29-4883-b0bd-e2abce1fad9e [ 603.142484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.142484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.142484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.142484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.142484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.142484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:790ab134-3d29-4883-b0bd-e2abce1fad9e already deleted. [ 603.142484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-790ab134-3d29-4883-b0bd-e2abce1fad9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.385136] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.385367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.385483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.385890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.386168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.386279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.386349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.386593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.386737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.386852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.387055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.387222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.387294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.387466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.387638] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.387819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.387884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.388057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.388141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.388224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.388345] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.424155] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: SUCCESS [ 603.424416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.595022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.595175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.595369] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.596431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b82d1fa3-c300-40f8-9317-540c277089c0 with status ACTIVE [ 603.596712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.596878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.596878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.597319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.597319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.597476] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.597476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.597615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.597760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.597866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.599770] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.599770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.599770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.599770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.599770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.599770] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b82d1fa3-c300-40f8-9317-540c277089c0 is going to be updated. [ 603.629817] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.629817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.629817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.629817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.629817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.629817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.892588] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a1f130e-cc8b-4415-87be-b7a8cbdda189: rpc.has_security_group_logging(os_id): False [ 603.920324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.920397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.920436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.920702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.920765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.920926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.921779] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.921779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.922037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.922037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.922942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.923140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.923217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.923403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.923485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.923661] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be created. [ 603.996956] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.997775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.997775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.997775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.997775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.010286] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 604.102463] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.605985] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.606271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.606920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.606920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.606920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.606920] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be created. [ 604.634211] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.636863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.636863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.636863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.636863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.645816] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: UNINITIALIZED for 2s [ 604.860182] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 604.860525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.860818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.862896] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.862896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.862896] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.367801] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.368380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.368380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.368380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.368534] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.368534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.368615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.368744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.368850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.368918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.369087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.369851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.369851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.369851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.369851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.369851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.369851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.370172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.370172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.370172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.370269] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.872407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4c36af1-3224-4449-b91e-20d98bbff745: rpc.has_security_group_logging(os_id): False [ 605.890274] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.890519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.890637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.890860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.891036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.891311] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.891370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.891412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.891572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.891650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.891823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.891918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.892049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.892370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.892461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.892719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.892821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.892882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.893036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.893111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.893196] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be created. [ 605.958042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.958341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.959069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.959069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.959219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.975289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 606.025365] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 606.026030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.657838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 606.658111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.658303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.658524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.658718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.658837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.658904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.659086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.659182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.659266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.659355] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.162407] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.344398] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b14de91d-39a5-4f46-83b5-30e90f8ee403 None None] Enqueued Resource ID: 408d7018-c10c-4570-b353-37921bacdac5 with Priority: HIGHEST for action port [ 607.345024] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408d7018-c10c-4570-b353-37921bacdac5 with Priority: HIGHEST for action port [ 607.345390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-408d7018-c10c-4570-b353-37921bacdac5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.345548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-408d7018-c10c-4570-b353-37921bacdac5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.345658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-408d7018-c10c-4570-b353-37921bacdac5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.345974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-408d7018-c10c-4570-b353-37921bacdac5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.346206] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('408d7018-c10c-4570-b353-37921bacdac5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.665063] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7654edec-ade1-480e-832c-a02879a9e17c: rpc.has_security_group_logging(os_id): False [ 607.691241] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.691530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.691627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.691991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.692217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.693408] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.693408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.693690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.694908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.694983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.695153] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be created. [ 607.798629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.798802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.798887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.799767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.800136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.816171] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 607.850150] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 408d7018-c10c-4570-b353-37921bacdac5 [ 607.850150] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.850150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.850150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.850150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.850150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.850150] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:408d7018-c10c-4570-b353-37921bacdac5 already deleted. [ 607.850150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-408d7018-c10c-4570-b353-37921bacdac5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.990424] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 607.990982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.695597] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a18e531c-1602-40af-bac8-395eae923edd tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 608.696347] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 608.697160] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.697351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.697425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.697846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.697953] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.224792] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.225176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.225249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.225459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.225554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.225641] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 already deleted. [ 609.225721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.413243] env[65222]: INFO networking_nsxv3.common.synchronization [None req-98f6eea5-d53d-4133-8ea0-04e2624bd8ec None None] Enqueued Resource ID: 3f98faea-e0fa-44c8-9ee6-9f27fcb9312e with Priority: HIGHEST for action port [ 609.413791] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f98faea-e0fa-44c8-9ee6-9f27fcb9312e with Priority: HIGHEST for action port [ 609.414392] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f98faea-e0fa-44c8-9ee6-9f27fcb9312e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.415447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f98faea-e0fa-44c8-9ee6-9f27fcb9312e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.415447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f98faea-e0fa-44c8-9ee6-9f27fcb9312e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.415447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f98faea-e0fa-44c8-9ee6-9f27fcb9312e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.415447] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f98faea-e0fa-44c8-9ee6-9f27fcb9312e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.718031] env[65222]: INFO networking_nsxv3.common.synchronization [None req-585d3966-2e73-438b-a31b-308e3c091601 None None] Enqueued Resource ID: e1090d4a-9ecf-48b0-bdb0-c448234176d0 with Priority: HIGHEST for action port [ 609.718031] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1090d4a-9ecf-48b0-bdb0-c448234176d0 with Priority: HIGHEST for action port [ 609.718031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1090d4a-9ecf-48b0-bdb0-c448234176d0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.718031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1090d4a-9ecf-48b0-bdb0-c448234176d0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.718031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1090d4a-9ecf-48b0-bdb0-c448234176d0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.718031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1090d4a-9ecf-48b0-bdb0-c448234176d0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.718031] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1090d4a-9ecf-48b0-bdb0-c448234176d0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.731023] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0a69acb3-8006-41de-9ce9-6d6093196ec7 tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 609.731023] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 609.731023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.731023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.731712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.731990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.732100] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.828735] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 609.829427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.918011] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f98faea-e0fa-44c8-9ee6-9f27fcb9312e [ 609.918385] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.918561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.918629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.918887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.918978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.919093] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f98faea-e0fa-44c8-9ee6-9f27fcb9312e already deleted. [ 609.919175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f98faea-e0fa-44c8-9ee6-9f27fcb9312e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.021598] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0b9420c3-a2df-478d-a7fc-c5001ad5b538 None None] Enqueued Resource ID: ca2382e9-280d-4ebf-82d3-90d59c873eed with Priority: HIGHEST for action port [ 610.025032] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2382e9-280d-4ebf-82d3-90d59c873eed with Priority: HIGHEST for action port [ 610.025142] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca2382e9-280d-4ebf-82d3-90d59c873eed taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.025285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca2382e9-280d-4ebf-82d3-90d59c873eed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.025319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca2382e9-280d-4ebf-82d3-90d59c873eed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.025891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca2382e9-280d-4ebf-82d3-90d59c873eed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.025891] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2382e9-280d-4ebf-82d3-90d59c873eed',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.220904] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1090d4a-9ecf-48b0-bdb0-c448234176d0 [ 610.221203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.221941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.222500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.222500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.222500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.222715] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1090d4a-9ecf-48b0-bdb0-c448234176d0 already deleted. [ 610.222715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1090d4a-9ecf-48b0-bdb0-c448234176d0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.261681] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.261681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.261681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.261681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.261681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.261681] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 already deleted. [ 610.262183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.529506] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca2382e9-280d-4ebf-82d3-90d59c873eed [ 610.529506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.529506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.529506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.529506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.529830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.529830] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca2382e9-280d-4ebf-82d3-90d59c873eed already deleted. [ 610.529830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca2382e9-280d-4ebf-82d3-90d59c873eed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.869827] env[65222]: INFO networking_nsxv3.common.synchronization [req-7f10568b-c32d-4fcf-81fb-36de39edfd68 req-4667f131-052d-4f19-bd00-716d7143708e tempest-VolumesAssistedSnapshotsTest-1127806725 tempest-VolumesAssistedSnapshotsTest-1127806725-project-member] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 611.869827] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 611.869827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.869827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.869827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.869827] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.984259] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4053ebd2-ff4f-4c80-a346-1ff8630c0284 None None] Enqueued Resource ID: f5a8a0d1-ac7e-46df-bbd2-2d495c554423 with Priority: HIGHEST for action port [ 611.985399] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a8a0d1-ac7e-46df-bbd2-2d495c554423 with Priority: HIGHEST for action port [ 611.986146] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5a8a0d1-ac7e-46df-bbd2-2d495c554423 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.987028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5a8a0d1-ac7e-46df-bbd2-2d495c554423" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.987028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5a8a0d1-ac7e-46df-bbd2-2d495c554423" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.987898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5a8a0d1-ac7e-46df-bbd2-2d495c554423" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.987898] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5a8a0d1-ac7e-46df-bbd2-2d495c554423',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.372666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.372853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.372938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.373260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.373260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.373424] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.373518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.373581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.373729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.373805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.373890] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 already deleted. [ 612.373972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.407696] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.407906] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-497" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.408048] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-497" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.408387] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-497" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.408657] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.408812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.408923] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.412670] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.412834] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.413060] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.413218] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.413335] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.413440] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.413546] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.413647] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.413775] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.444390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.444390] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.444390] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.444390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-497" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.444390] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-13d74cee-880f-4f59-aa52-8db1dd78b292 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.444390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.444390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.445530] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.445530] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d74cee-880f-4f59-aa52-8db1dd78b292',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.491659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5a8a0d1-ac7e-46df-bbd2-2d495c554423 [ 612.493374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.493374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.493374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.493374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.493374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.493374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5a8a0d1-ac7e-46df-bbd2-2d495c554423 already deleted. [ 612.493374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5a8a0d1-ac7e-46df-bbd2-2d495c554423" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.813956] env[65222]: INFO networking_nsxv3.common.synchronization [None req-defe8d99-d9a4-4676-bed9-c79d685a1d74 None None] Enqueued Resource ID: eb9e2323-49c9-4b80-adb0-02952a0f6d75 with Priority: HIGHEST for action port [ 612.815607] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb9e2323-49c9-4b80-adb0-02952a0f6d75 with Priority: HIGHEST for action port [ 612.816164] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb9e2323-49c9-4b80-adb0-02952a0f6d75 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.816164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb9e2323-49c9-4b80-adb0-02952a0f6d75" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.816164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb9e2323-49c9-4b80-adb0-02952a0f6d75" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.816438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb9e2323-49c9-4b80-adb0-02952a0f6d75" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.816488] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9e2323-49c9-4b80-adb0-02952a0f6d75',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.951363] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.951690] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.952369] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.952794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.952955] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.953125] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 13d74cee-880f-4f59-aa52-8db1dd78b292 not found, creating... [ 612.953418] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.953582] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.953693] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.953940] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.954083] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.954366] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.954532] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.954652] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.954865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.955031] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.955214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 13d74cee-880f-4f59-aa52-8db1dd78b292 is going to be created. [ 612.978549] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.978807] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.978891] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.979149] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.980028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.980028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.019023] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d47f395-a2aa-45e1-944f-c95aa15ea240 req-cae3cb34-76cc-4091-b50e-1ddcce9b90f0 tempest-ServersV294TestFqdnHostnames-1538117571 tempest-ServersV294TestFqdnHostnames-1538117571-project-member] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 613.019541] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 613.019873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.020016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.020110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.020349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.020499] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.020586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.020651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.020803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.020903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.021044] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.319254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb9e2323-49c9-4b80-adb0-02952a0f6d75 [ 613.319851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.319997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.320099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.320304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320519] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb9e2323-49c9-4b80-adb0-02952a0f6d75 already deleted. [ 613.320574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb9e2323-49c9-4b80-adb0-02952a0f6d75" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.523644] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.523981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.523981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.524283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.524654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.524808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.524890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.524948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.525169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.525242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.525307] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 already deleted. [ 613.525398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [req-7f10568b-c32d-4fcf-81fb-36de39edfd68 req-fa1c43df-6aeb-4dd4-bb26-60ad3953aa55 service nova] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [req-7f10568b-c32d-4fcf-81fb-36de39edfd68 req-fa1c43df-6aeb-4dd4-bb26-60ad3953aa55 service nova] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [req-7f10568b-c32d-4fcf-81fb-36de39edfd68 req-fa1c43df-6aeb-4dd4-bb26-60ad3953aa55 service nova] Enqueued Resource ID: 13d74cee-880f-4f59-aa52-8db1dd78b292 with Priority: HIGHEST for action port [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_rules [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 613.671970] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d74cee-880f-4f59-aa52-8db1dd78b292 with Priority: HIGHEST for action port [ 613.671970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.671970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.671970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.671970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.671970] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.672339] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.672339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.672339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.672616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.672679] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.672843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.672843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.672975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.673069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.673155] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.677140] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-13d74cee-880f-4f59-aa52-8db1dd78b292 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.677359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.677359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.677562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.677620] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d74cee-880f-4f59-aa52-8db1dd78b292',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.818982] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.819269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-882" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.819403] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-882" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.819738] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-882" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.820075] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.820256] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.820413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.820654] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.820795] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.821000] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.821127] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.821232] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.821352] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.821428] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.821524] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.821649] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.845454] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.845454] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.845454] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.845454] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-882" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.845454] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-354eb30c-2e89-44c6-829f-d2b96717c0a6 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.845454] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.845454] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.845454] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.845454] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354eb30c-2e89-44c6-829f-d2b96717c0a6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.179678] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.181069] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.181239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.181529] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13d74cee-880f-4f59-aa52-8db1dd78b292 with status ACTIVE [ 614.181703] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.181817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.182052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.182166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.182166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.182331] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.182444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.182524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.182866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.182866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.182866] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.183051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.183051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.183210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.183256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.183296] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13d74cee-880f-4f59-aa52-8db1dd78b292 is going to be updated. [ 614.206846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.207100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.207100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.207318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.207318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.207535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13d74cee-880f-4f59-aa52-8db1dd78b292" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.348490] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.348708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.348820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.349124] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.349272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.349431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 354eb30c-2e89-44c6-829f-d2b96717c0a6 not found, creating... [ 614.349682] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.349828] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.349938] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.350180] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.350303] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.350578] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.350740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.350849] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.351196] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.351349] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.351487] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 354eb30c-2e89-44c6-829f-d2b96717c0a6 is going to be created. [ 614.376557] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.376842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.376842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.377173] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.377389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.378561] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.682590] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.128038] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d47f395-a2aa-45e1-944f-c95aa15ea240 req-67a9e99a-e64a-41f8-b07b-1342709bebfc service nova] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 615.128197] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d47f395-a2aa-45e1-944f-c95aa15ea240 req-67a9e99a-e64a-41f8-b07b-1342709bebfc service nova] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 615.128333] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d47f395-a2aa-45e1-944f-c95aa15ea240 req-67a9e99a-e64a-41f8-b07b-1342709bebfc service nova] Enqueued Resource ID: 354eb30c-2e89-44c6-829f-d2b96717c0a6 with Priority: HIGHEST for action port [ 615.129865] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_rules [ 615.129865] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 615.130089] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354eb30c-2e89-44c6-829f-d2b96717c0a6 with Priority: HIGHEST for action port [ 615.130318] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.130318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.133265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.133430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.133521] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.134479] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.134600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.134666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.134841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135123] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.135123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.135221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.135291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.135974] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.136505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-354eb30c-2e89-44c6-829f-d2b96717c0a6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.136629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.136674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.137829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.137829] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354eb30c-2e89-44c6-829f-d2b96717c0a6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.186340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.186340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.186340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.186340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.186340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.186340] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 is going to be created. [ 615.214458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.214458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.214458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.214859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.215253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.227979] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: UNINITIALIZED for 2s [ 615.423866] env[65222]: INFO networking_nsxv3.common.synchronization [None req-3c4265bf-0ce3-4cc0-b695-269e3619fbf8 None None] Enqueued Resource ID: b8f74871-8189-4238-a0c0-7e6059174cd2 with Priority: HIGHEST for action port [ 615.423866] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f74871-8189-4238-a0c0-7e6059174cd2 with Priority: HIGHEST for action port [ 615.424023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8f74871-8189-4238-a0c0-7e6059174cd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.424158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8f74871-8189-4238-a0c0-7e6059174cd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.424219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8f74871-8189-4238-a0c0-7e6059174cd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.424482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8f74871-8189-4238-a0c0-7e6059174cd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.424560] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8f74871-8189-4238-a0c0-7e6059174cd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.642458] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.642458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.642458] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 354eb30c-2e89-44c6-829f-d2b96717c0a6 with status ACTIVE [ 615.642458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.642458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.642458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.643125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.643125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.644986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.645140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.645196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.645446] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 354eb30c-2e89-44c6-829f-d2b96717c0a6 is going to be updated. [ 615.670075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.670359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.670359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.670553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.670827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.670827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-354eb30c-2e89-44c6-829f-d2b96717c0a6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.865123] env[65222]: INFO networking_nsxv3.common.synchronization [req-ba5beafe-6deb-466a-87ae-fa383d3922b9 req-4b733cd2-d530-4a88-8a0c-4ba32a732923 tempest-ListImageFiltersTestJSON-1062059555 tempest-ListImageFiltersTestJSON-1062059555-project-member] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 615.865123] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 615.866502] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.866923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.867200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.867687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.868186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.868618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.868852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.869254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.870682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.870682] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.929241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8f74871-8189-4238-a0c0-7e6059174cd2 [ 615.929241] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.929241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.929241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.929241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.929241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.929241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8f74871-8189-4238-a0c0-7e6059174cd2 already deleted. [ 615.929241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8f74871-8189-4238-a0c0-7e6059174cd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.148737] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.374032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.374032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.374032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.374839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.374839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.374839] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee already deleted. [ 616.374839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.398238] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.398553] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.398690] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.399076] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.399438] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.399640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.399862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.400191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.400397] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.400681] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.400831] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.400996] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.401118] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.401250] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.401384] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.401525] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.424546] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.424728] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.424851] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.426028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.426028] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-d452ec61-3502-4f5e-9bfc-8411a6b05da4 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.426028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.426028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.426357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.426357] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d452ec61-3502-4f5e-9bfc-8411a6b05da4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.651079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.651236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.651284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.651508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.651598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.651696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 is going to be created. [ 616.678521] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.678727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.678792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.678977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.679184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.690262] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: UNINITIALIZED for 2s [ 616.929656] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.929898] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.930010] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.930331] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.930484] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.930645] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port d452ec61-3502-4f5e-9bfc-8411a6b05da4 not found, creating... [ 616.934025] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.934025] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.934025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.934446] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: d452ec61-3502-4f5e-9bfc-8411a6b05da4 is going to be created. [ 616.953980] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.954230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.954350] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.954609] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.955540] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.955540] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244920] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: SUCCESS [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.244920] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244920] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.422771] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e87862eb-bf76-46ee-96b4-0a439409c952 None None] Enqueued Resource ID: dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b with Priority: HIGHEST for action port [ 617.423219] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b with Priority: HIGHEST for action port [ 617.423528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.423638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.423705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.423964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.424085] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.454333] env[65222]: INFO networking_nsxv3.common.synchronization [None req-69c32a1c-59c9-4497-a7b5-46ffbadb9644 None None] Enqueued Resource ID: 5ccae1ba-2309-4603-b436-1cf85e56c810 with Priority: HIGHEST for action port [ 617.454917] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccae1ba-2309-4603-b436-1cf85e56c810 with Priority: HIGHEST for action port [ 617.455270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ccae1ba-2309-4603-b436-1cf85e56c810 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.455420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ccae1ba-2309-4603-b436-1cf85e56c810" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.455486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ccae1ba-2309-4603-b436-1cf85e56c810" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.455845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ccae1ba-2309-4603-b436-1cf85e56c810" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.455975] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ccae1ba-2309-4603-b436-1cf85e56c810',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.654115] env[65222]: INFO networking_nsxv3.common.synchronization [req-ba5beafe-6deb-466a-87ae-fa383d3922b9 req-b054efb4-ba65-4a81-bc6d-3518c30c6d3e service nova] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_rules [ 617.654115] env[65222]: INFO networking_nsxv3.common.synchronization [req-ba5beafe-6deb-466a-87ae-fa383d3922b9 req-b054efb4-ba65-4a81-bc6d-3518c30c6d3e service nova] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 617.654115] env[65222]: INFO networking_nsxv3.common.synchronization [req-ba5beafe-6deb-466a-87ae-fa383d3922b9 req-b054efb4-ba65-4a81-bc6d-3518c30c6d3e service nova] Enqueued Resource ID: d452ec61-3502-4f5e-9bfc-8411a6b05da4 with Priority: HIGHEST for action port [ 617.654612] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_rules [ 617.654841] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 617.654939] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452ec61-3502-4f5e-9bfc-8411a6b05da4 with Priority: HIGHEST for action port [ 617.658204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.658204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.658204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.658204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.658204] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.659047] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.659173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.659233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.659448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.659610] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.659726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.659785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.659935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.660154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.660154] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.663695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-d452ec61-3502-4f5e-9bfc-8411a6b05da4 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.663695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.663695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.663695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.663695] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d452ec61-3502-4f5e-9bfc-8411a6b05da4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.746801] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.926376] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b [ 617.928032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.928032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.928032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.928032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.928032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.928032] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b already deleted. [ 617.929404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe64e5b-25ff-4603-8bdd-3ee2a7eacd8b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.957992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ccae1ba-2309-4603-b436-1cf85e56c810 [ 617.958139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.958272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.958339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.958561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.958646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.958741] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ccae1ba-2309-4603-b436-1cf85e56c810 already deleted. [ 617.958832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ccae1ba-2309-4603-b436-1cf85e56c810" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.164512] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.166423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.166423] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.166975] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d452ec61-3502-4f5e-9bfc-8411a6b05da4 with status ACTIVE [ 618.167332] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.169025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.169025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.169025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.169025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.173024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.173024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.173024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.173024] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d452ec61-3502-4f5e-9bfc-8411a6b05da4 is going to be updated. [ 618.201615] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.201807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.201869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.202072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.202600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.202600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d452ec61-3502-4f5e-9bfc-8411a6b05da4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.253863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9616c573-a4bd-486e-9a65-e040235f1bd2: rpc.has_security_group_logging(os_id): False [ 618.288221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.288768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.288768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.288768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.288768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.289374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.289374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.289374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.289374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.289374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.290064] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 is going to be created. [ 618.422234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.422611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.422611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.422805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.423052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.437914] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: IN_PROGRESS for 2s [ 618.511797] env[65222]: INFO networking_nsxv3.common.synchronization [req-582e42ba-b010-4216-a85d-e4dd1022866f req-ea0b18fd-581a-4f1f-b845-6ad190cb6ea4 tempest-TenantUsagesTestJSON-1457058631 tempest-TenantUsagesTestJSON-1457058631-project-member] Enqueued Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 618.512456] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 618.513320] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.513320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.513320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.515773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.515998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.516140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.516208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.516419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.516511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.517623] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.678597] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.703016] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: SUCCESS [ 618.703205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.703871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.704742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.704742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.704742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.704742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.704742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.704742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.705113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.705113] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.987038] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.988442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.988442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.989445] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.989445] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.989445] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.989445] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.989618] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.989729] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.989950] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.990076] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.990174] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.990277] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.990382] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.990483] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.990619] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.022125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.022393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.022503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.022828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.022953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.023343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.023422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.023532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.023802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.023880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.023998] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 already deleted. [ 619.024127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.047033] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.047033] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.048500] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.048500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.048500] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b82eaa34-2a75-4547-a7e9-23dde53f1dac taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.048500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.048500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.048500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.048500] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82eaa34-2a75-4547-a7e9-23dde53f1dac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.185118] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.185346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.185481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.185638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.185733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.185886] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be created. [ 619.208862] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.217982] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.218598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.218598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.219944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.219944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.234207] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: UNINITIALIZED for 2s [ 619.556247] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.556247] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b82eaa34-2a75-4547-a7e9-23dde53f1dac not found, creating... [ 619.556247] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.556247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.556939] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.556939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.556939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.557069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.557213] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.557350] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b82eaa34-2a75-4547-a7e9-23dde53f1dac is going to be created. [ 619.587637] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.588461] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.588661] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.588883] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.589161] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.589389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.711250] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e07da58d-d6f4-45da-8971-0e6a2ab8b846: rpc.has_security_group_logging(os_id): False [ 619.738296] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.738674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.738811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.739155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.739375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.739795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.739985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.740227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.740425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.740556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.740682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 is going to be created. [ 619.809796] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.810021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.810088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.810285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.810602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.822413] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: IN_PROGRESS for 2s [ 619.936377] env[65222]: INFO networking_nsxv3.common.synchronization [None req-67f55a52-1122-46fe-b951-b92728ac2835 None None] Enqueued Resource ID: b5082bfa-7d91-4bc8-86a7-698fb30d6e4a with Priority: HIGHEST for action port [ 619.936860] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5082bfa-7d91-4bc8-86a7-698fb30d6e4a with Priority: HIGHEST for action port [ 619.940203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5082bfa-7d91-4bc8-86a7-698fb30d6e4a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.940733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5082bfa-7d91-4bc8-86a7-698fb30d6e4a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.940991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5082bfa-7d91-4bc8-86a7-698fb30d6e4a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.941469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5082bfa-7d91-4bc8-86a7-698fb30d6e4a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.941731] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5082bfa-7d91-4bc8-86a7-698fb30d6e4a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.329599] env[65222]: INFO networking_nsxv3.common.synchronization [req-582e42ba-b010-4216-a85d-e4dd1022866f req-0805ad16-014e-4070-b197-dd2326942b23 service nova] Enqueued Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_rules [ 620.329818] env[65222]: INFO networking_nsxv3.common.synchronization [req-582e42ba-b010-4216-a85d-e4dd1022866f req-0805ad16-014e-4070-b197-dd2326942b23 service nova] Enqueued Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 620.329903] env[65222]: INFO networking_nsxv3.common.synchronization [req-582e42ba-b010-4216-a85d-e4dd1022866f req-0805ad16-014e-4070-b197-dd2326942b23 service nova] Enqueued Resource ID: b82eaa34-2a75-4547-a7e9-23dde53f1dac with Priority: HIGHEST for action port [ 620.330491] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_rules [ 620.330626] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 620.330724] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b82eaa34-2a75-4547-a7e9-23dde53f1dac with Priority: HIGHEST for action port [ 620.331042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.331190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.331251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.333162] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.333162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.333162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.333162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.333763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.333763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.333763] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.334962] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b82eaa34-2a75-4547-a7e9-23dde53f1dac taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.334962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.334962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.334962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.334962] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82eaa34-2a75-4547-a7e9-23dde53f1dac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.446072] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5082bfa-7d91-4bc8-86a7-698fb30d6e4a [ 620.446665] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.446665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.446665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.446939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.446939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.446939] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5082bfa-7d91-4bc8-86a7-698fb30d6e4a already deleted. [ 620.447063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5082bfa-7d91-4bc8-86a7-698fb30d6e4a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.454347] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: SUCCESS [ 620.454612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.826779] env[65222]: INFO networking_nsxv3.common.synchronization [None req-78889769-4536-40fe-8662-4732dff5f85f None None] Enqueued Resource ID: 4e10de48-8628-4db0-8c10-fd341682867d with Priority: HIGHEST for action port [ 620.826779] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e10de48-8628-4db0-8c10-fd341682867d with Priority: HIGHEST for action port [ 620.827290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e10de48-8628-4db0-8c10-fd341682867d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.827290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e10de48-8628-4db0-8c10-fd341682867d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.827411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e10de48-8628-4db0-8c10-fd341682867d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.827619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e10de48-8628-4db0-8c10-fd341682867d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.827699] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e10de48-8628-4db0-8c10-fd341682867d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.836697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.836932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.838554] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.839464] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b82eaa34-2a75-4547-a7e9-23dde53f1dac with status ACTIVE [ 620.840064] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.840064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.840064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.840872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.840968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.841181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.841288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.841351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.841511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.841814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.841814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.841890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.841921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.842067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.842143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.842225] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b82eaa34-2a75-4547-a7e9-23dde53f1dac is going to be updated. [ 620.865991] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.866149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.866220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.866420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.866564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.866700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b82eaa34-2a75-4547-a7e9-23dde53f1dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.182586] env[65222]: INFO networking_nsxv3.common.synchronization [req-f84d9cb4-c07d-46d0-97e7-056414592512 req-6921abc3-1bb7-4c47-a3cd-1cc7b22f34b7 tempest-ListImageFiltersTestJSON-1062059555 tempest-ListImageFiltersTestJSON-1062059555-project-member] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 621.182768] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 621.183241] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.183241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.245648] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 621.246399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.246399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.246399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.246590] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.246733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.246798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.246987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.247054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.247133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.247248] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.248270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.248653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.248738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.249037] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.331151] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e10de48-8628-4db0-8c10-fd341682867d [ 621.331420] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.331578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.331649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.331873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.331965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.332508] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e10de48-8628-4db0-8c10-fd341682867d already deleted. [ 621.332616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e10de48-8628-4db0-8c10-fd341682867d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.345156] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.424538] env[65222]: INFO networking_nsxv3.common.synchronization [None req-acfe999f-f858-4506-a0a4-f45b72fcd92b tempest-ServersTestFqdnHostnames-1736055455 tempest-ServersTestFqdnHostnames-1736055455-project-member] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 621.425490] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 621.426135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.426328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.426407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.426622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.426732] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.670899] env[65222]: INFO networking_nsxv3.common.synchronization [None req-47e4ede8-cea7-43a6-8ca7-af614b92ac93 tempest-ServersTestFqdnHostnames-1736055455 tempest-ServersTestFqdnHostnames-1736055455-project-member] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 621.671624] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 621.673939] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.673939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.729754] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.729960] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.730120] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.730363] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.730614] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.730763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.730874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.731108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.731295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.731916] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.731916] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.731916] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.731916] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.731916] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.732202] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.732202] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.753176] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.753379] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.753518] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.753690] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.753999] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-6a4cea5a-be8e-4d77-9978-2a095c240c9b taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.754182] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.754293] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.754610] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.754744] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4cea5a-be8e-4d77-9978-2a095c240c9b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.755894] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.755894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.756070] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.833913] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: SUCCESS [ 621.834335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.847177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.847324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.847384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.847588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.847677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.847778] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 is going to be created. [ 621.872594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.872786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.872786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.872994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.873170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.882854] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: UNINITIALIZED for 2s [ 621.960263] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.960416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.960416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.960587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.960670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.960773] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 already deleted. [ 621.960922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.961143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.961281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.961366] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.258841] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.259101] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.259248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.259571] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259716] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.259902] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 6a4cea5a-be8e-4d77-9978-2a095c240c9b not found, creating... [ 622.260225] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.260408] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.260523] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.260738] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.260865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.261179] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.261753] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.262101] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.262434] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.262660] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.262822] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 6a4cea5a-be8e-4d77-9978-2a095c240c9b is going to be created. [ 622.264424] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.296562] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.298313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.298313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.298313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.298313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.298313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.486755] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.486755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.486755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.486755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.486755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.486755] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 already deleted. [ 622.486755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.767302] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.767571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.767688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.768017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.768178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.768325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be updated. [ 622.810255] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.810467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.810509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.810710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.810855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.823567] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 623.066770] env[65222]: INFO networking_nsxv3.common.synchronization [req-f84d9cb4-c07d-46d0-97e7-056414592512 req-71b0cc0c-af83-427c-a419-042d78a9f3f8 service nova] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_rules [ 623.067060] env[65222]: INFO networking_nsxv3.common.synchronization [req-f84d9cb4-c07d-46d0-97e7-056414592512 req-71b0cc0c-af83-427c-a419-042d78a9f3f8 service nova] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 623.067096] env[65222]: INFO networking_nsxv3.common.synchronization [req-f84d9cb4-c07d-46d0-97e7-056414592512 req-71b0cc0c-af83-427c-a419-042d78a9f3f8 service nova] Enqueued Resource ID: 6a4cea5a-be8e-4d77-9978-2a095c240c9b with Priority: HIGHEST for action port [ 623.067392] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_rules [ 623.067532] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 623.067635] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4cea5a-be8e-4d77-9978-2a095c240c9b with Priority: HIGHEST for action port [ 623.068244] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.068308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.068499] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.068583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.068786] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4cea5a-be8e-4d77-9978-2a095c240c9b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.068971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.068971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.069192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.069272] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4cea5a-be8e-4d77-9978-2a095c240c9b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.419719] env[65222]: INFO networking_nsxv3.common.synchronization [None req-079ff675-3d52-46f4-8fc2-904c8cd6b8b3 None None] Enqueued Resource ID: 88f606a4-a812-4333-9c93-8a5fa29a8562 with Priority: HIGHEST for action port [ 623.420500] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f606a4-a812-4333-9c93-8a5fa29a8562 with Priority: HIGHEST for action port [ 623.421075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f606a4-a812-4333-9c93-8a5fa29a8562 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.421345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f606a4-a812-4333-9c93-8a5fa29a8562" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.422497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f606a4-a812-4333-9c93-8a5fa29a8562" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.422905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f606a4-a812-4333-9c93-8a5fa29a8562" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.423232] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f606a4-a812-4333-9c93-8a5fa29a8562',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.571795] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a4cea5a-be8e-4d77-9978-2a095c240c9b with status ACTIVE [ 623.572024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.572174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.572245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.572470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.572565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.572751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.572843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.572945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.573133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.573211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.573409] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.574033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.574131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.574293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.574393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.574558] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a4cea5a-be8e-4d77-9978-2a095c240c9b is going to be updated. [ 623.601918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.602079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.602150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.602408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.602500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.602657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4cea5a-be8e-4d77-9978-2a095c240c9b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.625332] env[65222]: INFO networking_nsxv3.common.synchronization [req-bb43efa1-de7f-48bd-9516-c62696a44439 req-4af3efa1-8e30-48d4-ab3d-e03dbe2c53fa tempest-ServerAddressesTestJSON-1194550699 tempest-ServerAddressesTestJSON-1194550699-project-member] Enqueued Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 623.625530] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 623.625743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.625896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.626019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.628259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.628508] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.628662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.628755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.629013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.629161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.629269] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.896838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: SUCCESS [ 623.897108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.897307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.897559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.897770] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.898045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.898045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.898185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.898279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.898377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.901084] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.928050] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88f606a4-a812-4333-9c93-8a5fa29a8562 [ 623.929619] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.929619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.930675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.930675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.930970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.931186] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88f606a4-a812-4333-9c93-8a5fa29a8562 already deleted. [ 623.931457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f606a4-a812-4333-9c93-8a5fa29a8562" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.135808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.135808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.135808] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b already deleted. [ 624.135808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.175992] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.176245] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-674" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.176360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-674" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.176703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-674" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.181449] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.185023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.185023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.185023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.185023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.185023] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.185023] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.185023] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.185023] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.185023] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.185023] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.185023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.208192] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.208192] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.208192] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.208192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-674" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.208192] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.208192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.208192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.208192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.208192] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09522a4f-6b0a-4614-ab2e-d0e6e7a75323',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.404563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.404563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.404563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.406034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.406034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.406352] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.406352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.406352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.407088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.407088] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.407088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.407088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.407359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.407359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.407359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.407461] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.434534] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b84532aa-10c9-470c-9bf0-399299aabd8b None None] Enqueued Resource ID: 4a7a77fe-4522-4a41-bfca-07b2c15eb439 with Priority: HIGHEST for action port [ 624.435061] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7a77fe-4522-4a41-bfca-07b2c15eb439 with Priority: HIGHEST for action port [ 624.435359] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7a77fe-4522-4a41-bfca-07b2c15eb439 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.435473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7a77fe-4522-4a41-bfca-07b2c15eb439" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.435536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7a77fe-4522-4a41-bfca-07b2c15eb439" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.435944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7a77fe-4522-4a41-bfca-07b2c15eb439" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.436649] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7a77fe-4522-4a41-bfca-07b2c15eb439',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.711806] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.711999] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.712130] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.712390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.712526] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.712667] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 not found, creating... [ 624.712934] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.713069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.713180] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.713385] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.713746] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.713809] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.713962] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.714028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.714202] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.714324] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.714451] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 is going to be created. [ 624.735979] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.737015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.737015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.737015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.737015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.737165] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.835041] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 624.835041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.835041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.835446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.835446] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.835575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.835575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.835829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.835829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.835925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.836083] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.836997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.836997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.837252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.837252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.837252] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.838113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.838256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.839029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.839029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.839029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.839029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.839029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.839029] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.910992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcfa70a0-ebed-458c-8164-59735a1c9022: rpc.has_security_group_logging(os_id): False [ 624.930872] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.931047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.931168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.931678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.931678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.932110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.932226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.932293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.932972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.932972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.932972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.932972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.932972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.933327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.933327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.933327] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.933441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.933441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.934363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.935364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.935364] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 is going to be created. [ 624.939476] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a7a77fe-4522-4a41-bfca-07b2c15eb439 [ 624.939684] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.939772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.939834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.940027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.940130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.940186] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a7a77fe-4522-4a41-bfca-07b2c15eb439 already deleted. [ 624.940282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7a77fe-4522-4a41-bfca-07b2c15eb439" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.995845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.996043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.996256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.996296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.996466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.012650] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: IN_PROGRESS for 2s [ 625.341197] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 124a99d3-fe24-481b-88c5-184d5a1c99ee: rpc.has_security_group_logging(os_id): False [ 625.344292] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.364034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.364244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.364299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.364484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.364576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.364780] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.364879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.364940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.365167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.365230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.365389] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.365485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.365549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.365721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.365791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.365968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.366199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.366256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.366408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.366482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.366570] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be created. [ 625.451685] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.451837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.451917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.453032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.453032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.470092] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 625.572527] env[65222]: INFO networking_nsxv3.common.synchronization [req-bb43efa1-de7f-48bd-9516-c62696a44439 req-f234b3e8-1d34-42b6-9f73-cad0abd49e3c service nova] Enqueued Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_rules [ 625.572760] env[65222]: INFO networking_nsxv3.common.synchronization [req-bb43efa1-de7f-48bd-9516-c62696a44439 req-f234b3e8-1d34-42b6-9f73-cad0abd49e3c service nova] Enqueued Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 625.572946] env[65222]: INFO networking_nsxv3.common.synchronization [req-bb43efa1-de7f-48bd-9516-c62696a44439 req-f234b3e8-1d34-42b6-9f73-cad0abd49e3c service nova] Enqueued Resource ID: 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 with Priority: HIGHEST for action port [ 625.573468] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_rules [ 625.573628] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 625.573760] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 with Priority: HIGHEST for action port [ 625.575259] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.575461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.575562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.575904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.576030] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.576994] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.577853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.580996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.581537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.581695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.581853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.582086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.582303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.582951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.582951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.586668] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.586668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.586668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.586668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.586668] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09522a4f-6b0a-4614-ab2e-d0e6e7a75323',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.812345] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b39cc553-585c-474d-92cd-307f2a4fbbe0 tempest-ServersTestManualDisk-934677414 tempest-ServersTestManualDisk-934677414-project-member] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 625.812850] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 625.813161] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.813284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.813352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.813606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.813689] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.848348] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.951567] env[65222]: INFO networking_nsxv3.common.synchronization [None req-29d8aa0b-9ada-4207-bf51-86a6106960df tempest-ServersTestManualDisk-934677414 tempest-ServersTestManualDisk-934677414-project-member] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 625.952355] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 625.952688] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.952746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.089960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.089960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.089960] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.089960] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 with status ACTIVE [ 626.089960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.089960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.089960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.090324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.090324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.090482] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.092136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.092136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.092136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.094667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.094667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.094667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.094667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.094667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.094667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.094667] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09522a4f-6b0a-4614-ab2e-d0e6e7a75323 is going to be updated. [ 626.120067] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.120722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.120722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.120722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.120881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.121062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09522a4f-6b0a-4614-ab2e-d0e6e7a75323" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.340026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.340026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.340026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.340026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.340484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.340484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 already deleted. [ 626.340484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.340592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.340711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.340796] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.351858] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.352182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.352182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.352551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.352551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.352629] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be updated. [ 626.385379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.385379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.385540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.385953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.386149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.396168] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 626.596464] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.629045] env[65222]: INFO networking_nsxv3.common.synchronization [req-185fcb02-dbb6-435a-a158-f0bfab69370b req-63c416d7-9c3d-4c2a-8db1-d9f26c6451ab tempest-ServerExternalEventsTest-1933485113 tempest-ServerExternalEventsTest-1933485113-project-member] Enqueued Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 626.629927] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 626.630114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.630254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.630339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.630572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.630721] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.630812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.630868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.631373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.631858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.631858] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.869114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.869114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.869114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.869114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.869114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.869114] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 already deleted. [ 626.869114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.027102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: SUCCESS [ 627.027102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.100728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.100881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.100951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.101189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.101266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.101365] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b is going to be created. [ 627.135056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.135264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.138390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.138390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c already deleted. [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.138390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.138390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.138989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.153257] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: UNINITIALIZED for 2s [ 627.155957] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.156463] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.156463] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156744] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.157090] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.157940] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.157940] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.157940] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.158138] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.158378] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.158490] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.158590] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.158690] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.158791] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.158883] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.159033] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.183794] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.183794] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.183881] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.187045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.187045] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-1b948e77-c7df-48dc-a50e-1077111f4021 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.187045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.187045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.187045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.187045] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b948e77-c7df-48dc-a50e-1077111f4021',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.381783] env[65222]: INFO networking_nsxv3.common.synchronization [req-bc7cf1f1-48b4-4f38-99cf-991b221bb1dd req-087e537b-4075-4fcc-ab55-6e378f442874 tempest-DeleteServersAdminTestJSON-2088206556 tempest-DeleteServersAdminTestJSON-2088206556-project-admin] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 627.382257] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 627.382647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.382774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.382846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.386388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.386388] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.386592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.386592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.386805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.386892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.386993] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.389795] env[65222]: INFO networking_nsxv3.common.synchronization [None req-cb34e005-1762-43da-862a-351f8e136186 None None] Enqueued Resource ID: a361b647-c697-45ba-8a4d-0ac90380d26b with Priority: HIGHEST for action port [ 627.390558] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a361b647-c697-45ba-8a4d-0ac90380d26b with Priority: HIGHEST for action port [ 627.390794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a361b647-c697-45ba-8a4d-0ac90380d26b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.391184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a361b647-c697-45ba-8a4d-0ac90380d26b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.391184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a361b647-c697-45ba-8a4d-0ac90380d26b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.391357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a361b647-c697-45ba-8a4d-0ac90380d26b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.391393] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a361b647-c697-45ba-8a4d-0ac90380d26b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.503740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 627.503740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.503740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.503740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.503740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.689324] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.689622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.689749] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.690188] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.690285] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.690394] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 1b948e77-c7df-48dc-a50e-1077111f4021 not found, creating... [ 627.690676] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.690834] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.690962] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.691237] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.691380] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.691671] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.691819] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.691930] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.692243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.692377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.692600] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 1b948e77-c7df-48dc-a50e-1077111f4021 is going to be created. [ 627.725418] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.726127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.726127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.726275] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.726512] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.726824] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.891934] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.892036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.892208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.892426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.892581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.892873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.893030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.893137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.893367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.893942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.894101] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be updated. [ 627.895680] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a361b647-c697-45ba-8a4d-0ac90380d26b [ 627.896018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.896158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.896211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.896675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.896773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.896871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a361b647-c697-45ba-8a4d-0ac90380d26b already deleted. [ 627.896956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a361b647-c697-45ba-8a4d-0ac90380d26b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.934313] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.934500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.934500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.934731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.934868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.948371] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 628.007612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.007789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.409105] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 628.410609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.410609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.410609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.411867] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.411867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.411867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.411867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.411867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.411867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.411867] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.458848] env[65222]: INFO networking_nsxv3.common.synchronization [req-185fcb02-dbb6-435a-a158-f0bfab69370b req-5c6b5ed9-1259-4ab4-8187-4866f3528a26 service nova] Enqueued Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_rules [ 628.459135] env[65222]: INFO networking_nsxv3.common.synchronization [req-185fcb02-dbb6-435a-a158-f0bfab69370b req-5c6b5ed9-1259-4ab4-8187-4866f3528a26 service nova] Enqueued Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 628.459317] env[65222]: INFO networking_nsxv3.common.synchronization [req-185fcb02-dbb6-435a-a158-f0bfab69370b req-5c6b5ed9-1259-4ab4-8187-4866f3528a26 service nova] Enqueued Resource ID: 1b948e77-c7df-48dc-a50e-1077111f4021 with Priority: HIGHEST for action port [ 628.460370] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_rules [ 628.460370] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 628.461068] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b948e77-c7df-48dc-a50e-1077111f4021 with Priority: HIGHEST for action port [ 628.461068] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.461624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.461717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.461989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.462105] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.463368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.463368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.463368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.463490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.463542] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.464757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.464757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.464757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.464757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.464757] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.466457] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b948e77-c7df-48dc-a50e-1077111f4021 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.466457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.466457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.466457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.466457] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b948e77-c7df-48dc-a50e-1077111f4021',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.914850] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.915041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.915118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.916116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.916116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.916499] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.916499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.916499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.916499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.916628] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.916668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.916701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.916826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.916892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.916969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.917070] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.967602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.967795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.968196] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.968924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b948e77-c7df-48dc-a50e-1077111f4021 with status ACTIVE [ 628.969499] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.969499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.969499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.969705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.969705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.969860] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.969953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.970027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.970192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.970364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.970429] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.970509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.970554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.970743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.970743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.970826] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b948e77-c7df-48dc-a50e-1077111f4021 is going to be updated. [ 628.997347] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.997598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.997727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.998314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.998314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.998939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b948e77-c7df-48dc-a50e-1077111f4021" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.165445] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: SUCCESS [ 629.165782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.166529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.166529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.166529] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.166659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.166659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.166883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.167224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.168015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.168015] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.322371] env[65222]: INFO networking_nsxv3.common.synchronization [req-7bee46b6-a221-4a87-ab07-38cf92e1f809 req-426cf524-22c6-4462-a6c5-3d5534bfd0fa tempest-ServersTestBootFromVolume-1606057182 tempest-ServersTestBootFromVolume-1606057182-project-member] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 629.323627] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 629.324295] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.324295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.324295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.324578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.324716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.324823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.324886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.325061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.325151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.325245] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.420533] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 124a99d3-fe24-481b-88c5-184d5a1c99ee: rpc.has_security_group_logging(os_id): False [ 629.440283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.440822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.440822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.440822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.440822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.441013] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.441112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.441173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.441320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.441391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.442165] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.442165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.442165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.442165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.442165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.442387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.442387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.442387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.442629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.442629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.442629] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be updated. [ 629.475162] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.524293] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.524686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.524747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.525892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.525892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.546029] env[65222]: INFO networking_nsxv3.common.synchronization [None req-00abee62-a932-4ac0-a3d3-bce311a7acf1 None None] Enqueued Resource ID: bed89567-bb6b-44ff-a0b6-21c07a254efd with Priority: HIGHEST for action port [ 629.546029] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 629.547548] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed89567-bb6b-44ff-a0b6-21c07a254efd with Priority: HIGHEST for action port [ 629.549032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed89567-bb6b-44ff-a0b6-21c07a254efd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.549032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed89567-bb6b-44ff-a0b6-21c07a254efd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.549032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed89567-bb6b-44ff-a0b6-21c07a254efd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.549032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed89567-bb6b-44ff-a0b6-21c07a254efd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.549032] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed89567-bb6b-44ff-a0b6-21c07a254efd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.670481] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.670768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.670891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.671276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.672048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.672048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.672048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.672668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.672668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.672668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.674492] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.674632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.674693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.674909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.675153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.675328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.675328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.675578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.675578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.675650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.675772] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.829102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.829102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.829102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db already deleted. [ 629.829102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.966885] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 629.966885] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 deletion is rescheduled due to dependency. [ 629.966885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.977803] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.978036] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-265" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.978195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-265" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.978648] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-265" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.978861] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.979030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.979145] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.979377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.979614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.979740] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.979850] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.979951] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.980069] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.980174] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.980274] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.980449] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.982315] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.982434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.982434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.982620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.982736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.983157] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c is going to be created. [ 630.004201] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.004424] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.004593] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.004774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-265" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.005147] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-fbb671da-161f-46fa-9055-d03fe01ec605 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.005341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.005459] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.005825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005972] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb671da-161f-46fa-9055-d03fe01ec605',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.012106] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.012245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.012366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.012731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.012731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.026727] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: UNINITIALIZED for 2s [ 630.052801] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bed89567-bb6b-44ff-a0b6-21c07a254efd [ 630.053084] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.053209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.053280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.053798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.053798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.053798] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bed89567-bb6b-44ff-a0b6-21c07a254efd already deleted. [ 630.054041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed89567-bb6b-44ff-a0b6-21c07a254efd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.180758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18df73a9-aba7-4f1f-b77e-6e993274ef4b: rpc.has_security_group_logging(os_id): False [ 630.202289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.202475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.202522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.203354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.203354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.203354] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.203354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.203354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.204329] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.204329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.205900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.205900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.205900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.205900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.205900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.205900] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b is going to be created. [ 630.294135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.294329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.294400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.294694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.294909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.313718] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: IN_PROGRESS for 2s [ 630.510036] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.510377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.510377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.510684] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.511071] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.511071] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port fbb671da-161f-46fa-9055-d03fe01ec605 not found, creating... [ 630.511244] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.511397] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.511507] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.511722] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.511851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.512150] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.512300] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.512408] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.512608] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.512733] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.512863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: fbb671da-161f-46fa-9055-d03fe01ec605 is going to be created. [ 630.535212] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.535441] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.535557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.535851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.536339] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.536627] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.285395] env[65222]: INFO networking_nsxv3.common.synchronization [req-7bee46b6-a221-4a87-ab07-38cf92e1f809 req-c9cfd9f9-6290-42f6-95a8-2350aa653a1c service nova] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 631.286060] env[65222]: INFO networking_nsxv3.common.synchronization [req-7bee46b6-a221-4a87-ab07-38cf92e1f809 req-c9cfd9f9-6290-42f6-95a8-2350aa653a1c service nova] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 631.286060] env[65222]: INFO networking_nsxv3.common.synchronization [req-7bee46b6-a221-4a87-ab07-38cf92e1f809 req-c9cfd9f9-6290-42f6-95a8-2350aa653a1c service nova] Enqueued Resource ID: fbb671da-161f-46fa-9055-d03fe01ec605 with Priority: HIGHEST for action port [ 631.286855] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_rules [ 631.289048] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 631.289048] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb671da-161f-46fa-9055-d03fe01ec605 with Priority: HIGHEST for action port [ 631.289421] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.289569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.289943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.289943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.289943] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.291282] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.291411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.291503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.291689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.291915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.292117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.292326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.292326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.292498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.292795] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.294041] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb671da-161f-46fa-9055-d03fe01ec605 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.294041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.294041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.294041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.294041] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb671da-161f-46fa-9055-d03fe01ec605',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.561276] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 631.562086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.669395] env[65222]: INFO networking_nsxv3.common.synchronization [req-0e6386bf-dbbe-465a-8d82-7caee6433047 req-fdd6d019-58bc-4bd9-b954-debb41781390 tempest-FloatingIPsAssociationNegativeTestJSON-1547376287 tempest-FloatingIPsAssociationNegativeTestJSON-1547376287-project-member] Enqueued Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 631.670897] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 631.670897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.670897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.670897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.670897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.670897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.670897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.670897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.671321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.671321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.671321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.795820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.796024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.796167] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.797884] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbb671da-161f-46fa-9055-d03fe01ec605 with status ACTIVE [ 631.797884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.797884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.797884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.797884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.797884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.797884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.798375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.798375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.798375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.798375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.798530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.798607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.798648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.799337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.799337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.799337] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbb671da-161f-46fa-9055-d03fe01ec605 is going to be updated. [ 631.835568] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.835761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.835761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.836033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.836236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.836481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb671da-161f-46fa-9055-d03fe01ec605" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.041330] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: SUCCESS [ 632.041330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.041330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.041330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.041630] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.041693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.041768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.041934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.042033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.042143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.042260] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.132821] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.132821] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-400" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.133440] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-400" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.133692] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-400" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.134083] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.134365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.134535] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.134942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.135156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.135538] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.135805] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.135921] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.136108] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.136309] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.136452] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.136624] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.164527] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.164701] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.164807] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.165022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-400" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.165337] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.165506] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.165626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.166016] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.166152] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d30e2d-55ac-49e2-8180-2c9ef9fa620f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.173481] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.173724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.173872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.174170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.174303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.174557] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.174676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.174780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.174998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.175147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.175273] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c already deleted. [ 632.175385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.305033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.329433] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: SUCCESS [ 632.329804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.545120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.545265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.545324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.545552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.545729] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.545893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.545893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.546065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.546803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.546803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.546803] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.546803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.546803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.546803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.546803] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.547154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.547154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.547154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.547154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.547292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.547292] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.673024] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.673393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.673393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.673664] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.673804] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.673963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port e2d30e2d-55ac-49e2-8180-2c9ef9fa620f not found, creating... [ 632.674232] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.674383] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.674493] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.674749] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.674881] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.675435] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.675644] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.675772] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.676082] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.676170] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.676305] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: e2d30e2d-55ac-49e2-8180-2c9ef9fa620f is going to be created. [ 632.701209] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.701432] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.701569] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.701886] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.702039] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.702279] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.810358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.810358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.810358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.810358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.810358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.810358] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db is going to be created. [ 632.847272] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.849587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.849587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.849587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.849587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.865232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: UNINITIALIZED for 2s [ 633.049461] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6355cca5-8c96-4bbb-bc95-01de745d5b8c: rpc.has_security_group_logging(os_id): False [ 633.074290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.074290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.074290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.074290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.074290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.074824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.074824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.074824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.074999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.075070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.075309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.075435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.075512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.075661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.075722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.075926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.076098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.076183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.076360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.076443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.076531] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c is going to be created. [ 633.154280] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.154448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.154505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.157182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.157182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.170197] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: IN_PROGRESS for 2s [ 633.504344] env[65222]: INFO networking_nsxv3.common.synchronization [None req-718563f6-cc41-4a2a-9031-85c52e4b1a57 None None] Enqueued Resource ID: 835ae741-1036-4bef-b964-ed416f5c585d with Priority: HIGHEST for action port [ 633.508675] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835ae741-1036-4bef-b964-ed416f5c585d with Priority: HIGHEST for action port [ 633.509564] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-835ae741-1036-4bef-b964-ed416f5c585d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.510145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-835ae741-1036-4bef-b964-ed416f5c585d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.510279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-835ae741-1036-4bef-b964-ed416f5c585d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.511320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-835ae741-1036-4bef-b964-ed416f5c585d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.511483] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('835ae741-1036-4bef-b964-ed416f5c585d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [req-0e6386bf-dbbe-465a-8d82-7caee6433047 req-7fda05b4-2176-4893-9c42-06560b48fb1a service nova] Enqueued Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_rules [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [req-0e6386bf-dbbe-465a-8d82-7caee6433047 req-7fda05b4-2176-4893-9c42-06560b48fb1a service nova] Enqueued Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [req-0e6386bf-dbbe-465a-8d82-7caee6433047 req-7fda05b4-2176-4893-9c42-06560b48fb1a service nova] Enqueued Resource ID: e2d30e2d-55ac-49e2-8180-2c9ef9fa620f with Priority: HIGHEST for action port [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_rules [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 633.921736] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d30e2d-55ac-49e2-8180-2c9ef9fa620f with Priority: HIGHEST for action port [ 633.921736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.923386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.923386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.923628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.923743] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.925185] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.925341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.925771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.926517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.926761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.926938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.927047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.927275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.927527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.927726] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.928644] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.928755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.928822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.929036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.929079] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d30e2d-55ac-49e2-8180-2c9ef9fa620f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.015643] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 835ae741-1036-4bef-b964-ed416f5c585d [ 634.015876] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.016024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.016091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.016587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.016587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.016587] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:835ae741-1036-4bef-b964-ed416f5c585d already deleted. [ 634.016723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-835ae741-1036-4bef-b964-ed416f5c585d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.430444] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.431519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.431641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.432674] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2d30e2d-55ac-49e2-8180-2c9ef9fa620f with status ACTIVE [ 634.432674] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.432674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.432674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.432674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.432674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.433313] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.433313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.433313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.437116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.437116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.437116] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2d30e2d-55ac-49e2-8180-2c9ef9fa620f is going to be updated. [ 634.458673] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.458917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.458917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.459173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.459335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.459525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2d30e2d-55ac-49e2-8180-2c9ef9fa620f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.653841] env[65222]: INFO networking_nsxv3.common.synchronization [req-57e81feb-9903-4c3b-ac25-3fef22efa9d1 req-294cabea-d03d-4a7c-b9f9-cf8145b326f7 tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 634.654053] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 634.655109] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.655109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.655109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.655585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.657293] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.657293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.657809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.657809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.657809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.657809] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.879831] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: SUCCESS [ 634.880188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.880419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.880707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.880942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.884121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.884121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.884121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.884121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.884121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.884121] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.933507] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.957014] env[65222]: INFO networking_nsxv3.common.synchronization [req-4cc3ced0-47f8-42c7-985e-77e2b52d88ff req-c13f8d73-a976-49b6-acc1-c26f9226db87 tempest-ServerDiagnosticsNegativeTest-470585762 tempest-ServerDiagnosticsNegativeTest-470585762-project-member] Enqueued Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 634.957953] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGHEST for action security_group_members [ 634.958340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.958484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.958588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.958829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.959345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.959345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.959345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.959526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.959526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.959596] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.100239] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.100239] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.100239] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.100578] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.101781] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.101781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.101781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.101781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.101781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.101781] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.102128] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.102128] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.103141] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.103141] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.103141] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.103141] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.125437] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.125437] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.125437] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.125437] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.125437] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.125437] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.125437] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.125929] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.125968] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29802e3-7ae8-4d92-aab7-6f86be0e95a1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.161720] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.161890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.161982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.162248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.162365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.162566] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.162675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.162724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.162879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.162953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.163055] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 already deleted. [ 635.163138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.183497] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: SUCCESS [ 635.183694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.387665] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.436503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.436680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.436753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.436962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.437061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.437180] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c is going to be created. [ 635.465149] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.465149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.465149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.465369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.465581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.468051] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.469055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.469055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.469434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.469434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.469623] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.469860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.469963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.470243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.470360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.470462] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d is going to be updated. [ 635.489484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: UNINITIALIZED for 2s [ 635.509448] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.509448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.513988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.513988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.513988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.529723] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: IN_PROGRESS for 2s [ 635.631663] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.631901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.632139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.632368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.632456] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.632614] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port d29802e3-7ae8-4d92-aab7-6f86be0e95a1 not found, creating... [ 635.632870] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.633105] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.633174] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.633680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.633680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.633814] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.633876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.634204] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.634204] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.634353] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.634520] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: d29802e3-7ae8-4d92-aab7-6f86be0e95a1 is going to be created. [ 635.661691] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.661691] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.661691] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.661980] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.662199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.662743] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.889556] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fbc24f1-8254-4b9b-9b11-d6605f74d8db: rpc.has_security_group_logging(os_id): False [ 635.911650] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.911809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.911872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.912128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.912223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.912470] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.912576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.912627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.912782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.912856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.912971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db is going to be created. [ 636.066383] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.066383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.066383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.066383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.066383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.083441] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: IN_PROGRESS for 2s [ 636.531305] env[65222]: INFO networking_nsxv3.common.synchronization [req-57e81feb-9903-4c3b-ac25-3fef22efa9d1 req-f755bfaa-a9fa-4707-b006-40bc50133e47 service nova] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 636.531497] env[65222]: INFO networking_nsxv3.common.synchronization [req-57e81feb-9903-4c3b-ac25-3fef22efa9d1 req-f755bfaa-a9fa-4707-b006-40bc50133e47 service nova] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 636.531659] env[65222]: INFO networking_nsxv3.common.synchronization [req-57e81feb-9903-4c3b-ac25-3fef22efa9d1 req-f755bfaa-a9fa-4707-b006-40bc50133e47 service nova] Enqueued Resource ID: d29802e3-7ae8-4d92-aab7-6f86be0e95a1 with Priority: HIGHEST for action port [ 636.532309] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 636.532447] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 636.532569] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29802e3-7ae8-4d92-aab7-6f86be0e95a1 with Priority: HIGHEST for action port [ 636.532874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.532996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.533092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.533300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.533383] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.534277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.534382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.534450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.534623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.534774] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.534865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.534924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.535080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.535162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.535252] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.536530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.536596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.536667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.536840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.536906] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29802e3-7ae8-4d92-aab7-6f86be0e95a1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.039096] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.039096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.045126] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.045126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d29802e3-7ae8-4d92-aab7-6f86be0e95a1 with status ACTIVE [ 637.045126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.045126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.045953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045953] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d29802e3-7ae8-4d92-aab7-6f86be0e95a1 is going to be updated. [ 637.072849] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.073221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.073221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.073345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.073461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.073567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29802e3-7ae8-4d92-aab7-6f86be0e95a1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508506] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: SUCCESS [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.508506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508506] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.548063] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.550347] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c1005d5-d839-41cb-b881-ed288aaf593d in Status: SUCCESS [ 637.550542] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d deletion is rescheduled due to dependency. [ 637.550647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.010647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.010802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.010968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.011115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.011937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.011937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.011937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.011937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.011937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.011937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.011937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.012369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.012369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.012369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.012369] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.012572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.012572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.012633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.012706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.012755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.012841] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.055941] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.055941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.055941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.055941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.055941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.055941] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be created. [ 638.083319] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.083730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.083730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.084140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.084140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.095879] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: UNINITIALIZED for 2s [ 638.097433] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: SUCCESS [ 638.097732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.515684] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac38280-989d-45d7-bcb9-03b71f69154c: rpc.has_security_group_logging(os_id): False [ 638.541045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.541045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.541045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.541045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.541045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.541045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.543022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.543022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.543022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.544809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.544809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.544809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.544809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.544809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.544809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.546041] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.546041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.546041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.546041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.546041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.546430] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c is going to be created. [ 638.642287] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.642287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.642287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.642287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.642287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.667410] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: IN_PROGRESS for 2s [ 640.106591] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 640.106885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.107071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.107291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.107474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.107646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.107646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.107885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.107885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.107989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.108041] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.611891] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.682149] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: SUCCESS [ 640.682149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.114734] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44afacd5-bc37-4272-9409-ec05ce0c00f8: rpc.has_security_group_logging(os_id): False [ 641.134726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.134726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.134726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.135096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.136080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.137235] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.137235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.137235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.137235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.137235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.137467] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be created. [ 641.211324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.211566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.211639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.211943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.212158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.233464] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 641.534561] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 641.534830] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 642.624636] env[65222]: INFO networking_nsxv3.common.synchronization [None req-defeacae-ac25-414d-a759-2334b2bacb80 None None] Enqueued Resource ID: 73366bc3-1116-4e4c-b91b-ab1f0f8cdae3 with Priority: HIGHEST for action port [ 642.625195] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73366bc3-1116-4e4c-b91b-ab1f0f8cdae3 with Priority: HIGHEST for action port [ 642.625513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-73366bc3-1116-4e4c-b91b-ab1f0f8cdae3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.625614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73366bc3-1116-4e4c-b91b-ab1f0f8cdae3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.625683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73366bc3-1116-4e4c-b91b-ab1f0f8cdae3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.626129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73366bc3-1116-4e4c-b91b-ab1f0f8cdae3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.626495] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73366bc3-1116-4e4c-b91b-ab1f0f8cdae3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.129775] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73366bc3-1116-4e4c-b91b-ab1f0f8cdae3 [ 643.130025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.131124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.131124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.131124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.131124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.131393] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73366bc3-1116-4e4c-b91b-ab1f0f8cdae3 already deleted. [ 643.131393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73366bc3-1116-4e4c-b91b-ab1f0f8cdae3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.252470] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 643.252774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.060717] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a7acbcfb-b89f-421f-afe5-b03ace4b53e9 None None] Enqueued Resource ID: 9ec602aa-fb76-420b-a9b4-4aabda2a55a0 with Priority: HIGHEST for action port [ 644.061117] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec602aa-fb76-420b-a9b4-4aabda2a55a0 with Priority: HIGHEST for action port [ 644.061368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ec602aa-fb76-420b-a9b4-4aabda2a55a0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.061496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ec602aa-fb76-420b-a9b4-4aabda2a55a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.061562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ec602aa-fb76-420b-a9b4-4aabda2a55a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.061821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ec602aa-fb76-420b-a9b4-4aabda2a55a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.061904] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec602aa-fb76-420b-a9b4-4aabda2a55a0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.565442] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ec602aa-fb76-420b-a9b4-4aabda2a55a0 [ 644.565442] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.565442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.565442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.565442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.565442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.565966] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ec602aa-fb76-420b-a9b4-4aabda2a55a0 already deleted. [ 644.565966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ec602aa-fb76-420b-a9b4-4aabda2a55a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.575913] env[65222]: INFO networking_nsxv3.common.synchronization [req-881e72ce-605d-454a-9d8d-7456d8c1bc0e req-62d72cde-165a-4458-a95c-759a46d1bdec tempest-ServersTestFqdnHostnames-1736055455 tempest-ServersTestFqdnHostnames-1736055455-project-member] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 644.576439] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 644.576775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.577454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.577454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.577645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.577841] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.578315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.578427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.578620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.578709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.578807] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.012657] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.012880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-503" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.012948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-503" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.015090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-503" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.015090] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.015090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.015090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.015428] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.015580] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.015915] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.016172] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.016345] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.016483] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.016669] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.017203] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.017841] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.044385] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.044385] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.044591] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.044591] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-503" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.044908] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-e12787ed-e05c-4d18-9926-fecfee9dc96e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.045134] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.045204] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.045519] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.046034] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e12787ed-e05c-4d18-9926-fecfee9dc96e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.082233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.082605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.082605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.082728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.083397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.083397] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.083397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.083397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.083397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.083397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.083721] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 already deleted. [ 645.083721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.549598] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.549874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.550066] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.550523] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.550743] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.550986] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port e12787ed-e05c-4d18-9926-fecfee9dc96e not found, creating... [ 645.551460] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.551682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.552190] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.552561] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.553779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.553779] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.553779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.553779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.554122] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.554122] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.554337] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: e12787ed-e05c-4d18-9926-fecfee9dc96e is going to be created. [ 645.578625] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.578860] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.578994] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.579325] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.579549] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.579794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.794834] env[65222]: INFO networking_nsxv3.common.synchronization [None req-5afab651-b8a8-4326-b7bc-e94c4ab5cdec None None] Enqueued Resource ID: 12919dda-d036-4b43-942a-e99c290b6c71 with Priority: HIGHEST for action port [ 645.795551] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12919dda-d036-4b43-942a-e99c290b6c71 with Priority: HIGHEST for action port [ 645.795931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-12919dda-d036-4b43-942a-e99c290b6c71 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.796317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12919dda-d036-4b43-942a-e99c290b6c71" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.796408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12919dda-d036-4b43-942a-e99c290b6c71" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.796706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12919dda-d036-4b43-942a-e99c290b6c71" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.796821] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12919dda-d036-4b43-942a-e99c290b6c71',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.299725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12919dda-d036-4b43-942a-e99c290b6c71 [ 646.300129] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.300772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.300772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.301062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.301218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.301422] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12919dda-d036-4b43-942a-e99c290b6c71 already deleted. [ 646.301594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12919dda-d036-4b43-942a-e99c290b6c71" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.443508] env[65222]: INFO networking_nsxv3.common.synchronization [req-881e72ce-605d-454a-9d8d-7456d8c1bc0e req-5200c432-91ea-4bb5-9f2e-15d528e41c0f service nova] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 646.445209] env[65222]: INFO networking_nsxv3.common.synchronization [req-881e72ce-605d-454a-9d8d-7456d8c1bc0e req-5200c432-91ea-4bb5-9f2e-15d528e41c0f service nova] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 646.445391] env[65222]: INFO networking_nsxv3.common.synchronization [req-881e72ce-605d-454a-9d8d-7456d8c1bc0e req-5200c432-91ea-4bb5-9f2e-15d528e41c0f service nova] Enqueued Resource ID: e12787ed-e05c-4d18-9926-fecfee9dc96e with Priority: HIGHEST for action port [ 646.446074] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_rules [ 646.446307] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 646.446416] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12787ed-e05c-4d18-9926-fecfee9dc96e with Priority: HIGHEST for action port [ 646.446759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.446942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.447053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449374] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.449374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.449374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.449804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.450052] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.451171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e12787ed-e05c-4d18-9926-fecfee9dc96e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.451171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.451391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.451648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.451648] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e12787ed-e05c-4d18-9926-fecfee9dc96e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.876152] env[65222]: INFO networking_nsxv3.common.synchronization [req-957b56f6-8bbb-486b-807d-292516bf2cec req-d4e79952-5982-4c7c-a9d1-2c98d6720209 tempest-VolumesAdminNegativeTest-1562226656 tempest-VolumesAdminNegativeTest-1562226656-project-member] Enqueued Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 646.876983] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 646.881119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.881288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.881355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.881674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.881837] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.881950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.882039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.882248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.882248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.882403] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.955261] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.955495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.955765] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.960875] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e12787ed-e05c-4d18-9926-fecfee9dc96e with status ACTIVE [ 646.960875] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.960875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.960875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.960875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.960875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.960875] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.962951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.963121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.963424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.963492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.963899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.963899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.963899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.964138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.964138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.964243] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e12787ed-e05c-4d18-9926-fecfee9dc96e is going to be updated. [ 646.988560] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.988703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.988775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.989482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.989482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.989618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e12787ed-e05c-4d18-9926-fecfee9dc96e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.387144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.387144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.387503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.387503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.387914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.387959] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.388250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.388250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.388449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.388571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.388714] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 already deleted. [ 647.388848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.418968] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.418968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-969" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.418968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-969" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.419381] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-969" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.419586] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.419757] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.419757] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.419950] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.420128] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.420331] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.420435] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.420568] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.420684] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.420829] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.420945] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.421469] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.449365] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.449365] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.449365] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.449365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-969" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.449365] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-7a6d7f8d-eddc-4c20-892d-c1f12454755a taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.449365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.449365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.449365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.449365] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a6d7f8d-eddc-4c20-892d-c1f12454755a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.467999] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.955230] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.955527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.955708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.956036] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.956158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.956317] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 7a6d7f8d-eddc-4c20-892d-c1f12454755a not found, creating... [ 647.956594] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.956944] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.956944] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.957070] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.957197] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.957470] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.957615] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.957723] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.957920] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.958055] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.958284] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 7a6d7f8d-eddc-4c20-892d-c1f12454755a is going to be created. [ 647.969253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.969432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.969530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.969721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.969805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.969904] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 is going to be created. [ 647.982598] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.982870] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.983175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.983479] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.983752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.984399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.995958] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.996170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.996269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.996500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.996694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.009158] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: UNINITIALIZED for 2s [ 648.381020] env[65222]: INFO networking_nsxv3.common.synchronization [req-f5c2152e-7f6e-4a60-86e6-654083b4a495 req-8c10e55f-d8f5-4c69-aa39-ebb24e6bc4b1 tempest-TenantUsagesTestJSON-1457058631 tempest-TenantUsagesTestJSON-1457058631-project-member] Enqueued Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 648.382193] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGHEST for action security_group_members [ 648.382453] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.382663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.382764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.383107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.383337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.383528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.383663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.383928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.384191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.384336] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.493300] env[65222]: INFO networking_nsxv3.common.synchronization [None req-642194dc-697f-45d3-8999-59cbc309a566 None None] Enqueued Resource ID: d517619a-e99e-48b1-8089-3b6b4c95a777 with Priority: HIGHEST for action port [ 648.493300] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d517619a-e99e-48b1-8089-3b6b4c95a777 with Priority: HIGHEST for action port [ 648.493300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-d517619a-e99e-48b1-8089-3b6b4c95a777 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.493845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d517619a-e99e-48b1-8089-3b6b4c95a777" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.494658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d517619a-e99e-48b1-8089-3b6b4c95a777" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.494658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d517619a-e99e-48b1-8089-3b6b4c95a777" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.494658] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d517619a-e99e-48b1-8089-3b6b4c95a777',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.649146] env[65222]: INFO networking_nsxv3.common.synchronization [req-c8816dc9-982d-4d00-8a13-8e4a9fae43da req-084325e5-b9dc-44dd-9cee-fab7bd2606c8 tempest-ServerAddressesTestJSON-1194550699 tempest-ServerAddressesTestJSON-1194550699-project-member] Enqueued Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 648.650047] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGHEST for action security_group_members [ 648.651954] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.651954] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.651954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.651954] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.749613] env[65222]: INFO networking_nsxv3.common.synchronization [req-957b56f6-8bbb-486b-807d-292516bf2cec req-1ed1bcf5-6b94-4cfe-831c-d0b624746db3 service nova] Enqueued Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_rules [ 648.749987] env[65222]: INFO networking_nsxv3.common.synchronization [req-957b56f6-8bbb-486b-807d-292516bf2cec req-1ed1bcf5-6b94-4cfe-831c-d0b624746db3 service nova] Enqueued Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 648.750690] env[65222]: INFO networking_nsxv3.common.synchronization [req-957b56f6-8bbb-486b-807d-292516bf2cec req-1ed1bcf5-6b94-4cfe-831c-d0b624746db3 service nova] Enqueued Resource ID: 7a6d7f8d-eddc-4c20-892d-c1f12454755a with Priority: HIGHEST for action port [ 648.751250] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_rules [ 648.751458] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 648.751614] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6d7f8d-eddc-4c20-892d-c1f12454755a with Priority: HIGHEST for action port [ 648.752034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.752312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.752312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.752958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.753196] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.754539] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.754721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.754840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.755227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.755380] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.755553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.755625] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.755873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.756027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.756184] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.757388] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a6d7f8d-eddc-4c20-892d-c1f12454755a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.757552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.757652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.757891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.758016] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a6d7f8d-eddc-4c20-892d-c1f12454755a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.889072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.889072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.889072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.889303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.889405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.889640] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.889797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.889909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.890121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.890529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.890529] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 is going to be updated. [ 648.939496] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.939496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.939496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.939496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.939496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.951750] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: IN_PROGRESS for 2s [ 648.996386] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d517619a-e99e-48b1-8089-3b6b4c95a777 [ 648.996712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.996908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.997038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.997367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.997513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.997661] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d517619a-e99e-48b1-8089-3b6b4c95a777 already deleted. [ 648.997794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d517619a-e99e-48b1-8089-3b6b4c95a777" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.155360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.155682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.157459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.157459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.157459] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b is going to be updated. [ 649.195624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.195896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.195974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.196496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.196738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.210965] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: IN_PROGRESS for 2s [ 649.262200] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.262200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.262528] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.263703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a6d7f8d-eddc-4c20-892d-c1f12454755a with status ACTIVE [ 649.263703] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.263820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.263820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.265292] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.265292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.265725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.265725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.265725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.265850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.265934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.266038] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a6d7f8d-eddc-4c20-892d-c1f12454755a is going to be updated. [ 649.311681] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.312170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.312170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.312536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.312733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.312883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a6d7f8d-eddc-4c20-892d-c1f12454755a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.768666] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.940380] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf3d4d59-f1fe-4946-acbe-37543a4969a7 req-deca7b9d-11ce-4a6c-b610-c1e39879dce9 tempest-ServersTestManualDisk-934677414 tempest-ServersTestManualDisk-934677414-project-member] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 649.941045] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 649.941382] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.941540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.941651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.942123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.942368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.942515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.942610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.942834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.943144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.943219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.022780] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: SUCCESS [ 650.023859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.024060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.024334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.024665] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.024857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.024959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.025225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.025374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.025525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.025685] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.272925] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.273151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.273288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.273513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.273639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.273762] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 is going to be created. [ 650.331497] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.331723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.331723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.332014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.332245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.355540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: UNINITIALIZED for 2s [ 650.445710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.445930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.446025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.446205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.446316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.446518] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.446647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.446709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.446838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.446930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.447038] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 already deleted. [ 650.447143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.448875] env[65222]: INFO networking_nsxv3.common.synchronization [None req-45ac3ae9-7d11-4c01-81bd-e9a1b6d16768 None None] Enqueued Resource ID: 3389ebe3-6999-4fed-8ed5-a537200d2641 with Priority: HIGHEST for action port [ 650.450121] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3389ebe3-6999-4fed-8ed5-a537200d2641 with Priority: HIGHEST for action port [ 650.450641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3389ebe3-6999-4fed-8ed5-a537200d2641 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.450641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3389ebe3-6999-4fed-8ed5-a537200d2641" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.450768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3389ebe3-6999-4fed-8ed5-a537200d2641" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.450974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3389ebe3-6999-4fed-8ed5-a537200d2641" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.451077] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3389ebe3-6999-4fed-8ed5-a537200d2641',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.529107] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.651125] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.651423] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-422" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.651479] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-422" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.651863] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-422" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.652252] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.652434] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.652574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.652872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.653014] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.653270] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.653394] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.653495] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.653597] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.653704] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.653819] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.653953] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.676841] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.677117] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.677217] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.677485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-422" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.677882] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-99058c4d-549e-45f6-bc7d-d5326e85dde6 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.678131] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.678369] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.678810] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.678984] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99058c4d-549e-45f6-bc7d-d5326e85dde6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.957799] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3389ebe3-6999-4fed-8ed5-a537200d2641 [ 650.958282] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.958401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.958493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.958729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.958841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.958942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3389ebe3-6999-4fed-8ed5-a537200d2641 already deleted. [ 650.959146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3389ebe3-6999-4fed-8ed5-a537200d2641" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.967038] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcfa70a0-ebed-458c-8164-59735a1c9022 in Status: SUCCESS [ 650.967866] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 deletion is rescheduled due to dependency. [ 650.967866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.032730] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15ef4155-817c-4a1e-8484-6fde2baef247: rpc.has_security_group_logging(os_id): False [ 651.055027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.055027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.055027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.055027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.055027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.055446] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.055503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.055566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.055849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.055956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.056122] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 is going to be created. [ 651.136647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.136647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.136647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.136647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.136647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.150786] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: IN_PROGRESS for 2s [ 651.182081] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.182338] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.182501] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.182816] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.182963] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.186587] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 99058c4d-549e-45f6-bc7d-d5326e85dde6 not found, creating... [ 651.186991] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.187198] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.187312] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.187618] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.187764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.188097] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.188942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.188942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.188942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.188942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.188942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 99058c4d-549e-45f6-bc7d-d5326e85dde6 is going to be created. [ 651.229331] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b in Status: SUCCESS [ 651.229331] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b deletion is rescheduled due to dependency. [ 651.229331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.248337] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.248337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.248337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.248337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.248337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.248337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.943542] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf3d4d59-f1fe-4946-acbe-37543a4969a7 req-b56c133b-e1d1-49c4-a4c7-9159c08c5f5f service nova] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 651.943789] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf3d4d59-f1fe-4946-acbe-37543a4969a7 req-b56c133b-e1d1-49c4-a4c7-9159c08c5f5f service nova] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 651.943956] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf3d4d59-f1fe-4946-acbe-37543a4969a7 req-b56c133b-e1d1-49c4-a4c7-9159c08c5f5f service nova] Enqueued Resource ID: 99058c4d-549e-45f6-bc7d-d5326e85dde6 with Priority: HIGHEST for action port [ 651.944763] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_rules [ 651.944899] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 651.944995] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99058c4d-549e-45f6-bc7d-d5326e85dde6 with Priority: HIGHEST for action port [ 651.945283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.945404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.945767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.945767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.945852] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.946979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.947476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.947476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.947476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.947630] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.947685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.948541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.948909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.949046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.949151] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.951030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-99058c4d-549e-45f6-bc7d-d5326e85dde6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.951030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.951030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.951030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.951341] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99058c4d-549e-45f6-bc7d-d5326e85dde6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.368274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: SUCCESS [ 652.368798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.368798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.369074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.369382] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.369562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.369673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.369933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.370091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.370245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.370395] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.453139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.453494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.454601] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.455548] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99058c4d-549e-45f6-bc7d-d5326e85dde6 with status ACTIVE [ 652.455775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.455900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.455960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.456278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.456406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.456551] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.456653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.456779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.456858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.456926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.457113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.457200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.457279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.457415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.457486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.457580] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99058c4d-549e-45f6-bc7d-d5326e85dde6 is going to be updated. [ 652.490675] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.490944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.490944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.491147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.491287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.491455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99058c4d-549e-45f6-bc7d-d5326e85dde6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.874148] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.874409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.874563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.874795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.875288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.875288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.875288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.875665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.875665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.875785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.875938] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.876095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.876188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.876377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.876571] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.876714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.876824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.877041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877793] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.960325] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.169348] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: SUCCESS [ 653.169687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.383987] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3aaa7263-e1f6-48f6-b26b-4a463242fd35: rpc.has_security_group_logging(os_id): False [ 653.405532] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.406710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.409040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.409040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.409040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410483] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 is going to be created. [ 653.464726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.464726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.464726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.464726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.464726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.464726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 is going to be created. [ 653.490093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.490268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.490314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.490563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.490749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.498130] env[65222]: INFO networking_nsxv3.common.synchronization [None req-368823cc-e2de-41ab-b003-9ccc27de3983 None None] Enqueued Resource ID: a9d992e1-2525-409c-89f7-be6e362f9382 with Priority: HIGHEST for action port [ 653.498739] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d992e1-2525-409c-89f7-be6e362f9382 with Priority: HIGHEST for action port [ 653.499643] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d992e1-2525-409c-89f7-be6e362f9382 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.499786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d992e1-2525-409c-89f7-be6e362f9382" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.499848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d992e1-2525-409c-89f7-be6e362f9382" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.500200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d992e1-2525-409c-89f7-be6e362f9382" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.500868] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d992e1-2525-409c-89f7-be6e362f9382',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.506738] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: IN_PROGRESS for 2s [ 653.508011] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.508151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.508257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.508497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.508682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.520872] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: UNINITIALIZED for 2s [ 654.003433] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9d992e1-2525-409c-89f7-be6e362f9382 [ 654.003741] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.003925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.004041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.004306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.004400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.004532] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9d992e1-2525-409c-89f7-be6e362f9382 already deleted. [ 654.004677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d992e1-2525-409c-89f7-be6e362f9382" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.524205] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: SUCCESS [ 655.524581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.533446] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: SUCCESS [ 655.534105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.534105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.534404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.534640] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.534878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.536024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.536024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.536024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.536024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.536287] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.035207] env[65222]: INFO networking_nsxv3.common.synchronization [None req-fac58b89-2bf5-4f51-8cd3-08f440678fbf tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 656.035796] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 656.037050] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.037050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.037050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.039434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.039434] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.039434] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.394487] env[65222]: INFO networking_nsxv3.common.synchronization [None req-7b39d15c-8cf4-4639-99b9-7b3dd014f5d4 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 656.395273] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 656.398307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.398569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.542665] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc8b3202-aad0-4507-b032-c8b4d8908623: rpc.has_security_group_logging(os_id): False [ 656.565131] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.565282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.565356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.565596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.565695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.566146] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff already deleted. [ 656.566146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.566146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.566297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.567044] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.569916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.570210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.570210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.570427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.570543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.570811] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.570991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.570991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.571266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.571266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.571375] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 is going to be created. [ 656.636526] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.636749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.636806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.637099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.637316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.654740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: IN_PROGRESS for 2s [ 656.686489] env[65222]: INFO networking_nsxv3.common.synchronization [req-3d6d3df4-6dee-4071-a536-13dfbaed7bfe req-5c7c081f-c133-4cd4-82d9-13b57a84135b tempest-ServerExternalEventsTest-1933485113 tempest-ServerExternalEventsTest-1933485113-project-member] Enqueued Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 656.687064] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGHEST for action security_group_members [ 656.687549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.687722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.687813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.688096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.688392] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.688522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.688571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.688755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.688855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.688956] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.092917] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.092917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.092917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.092917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.093227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.093227] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff already deleted. [ 657.093227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.192516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.192751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.192890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.193194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.193351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.193623] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.193751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.193813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.193994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.194073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.195016] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c is going to be updated. [ 657.234205] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.234205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.235173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.235173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.235173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.246490] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: IN_PROGRESS for 2s [ 657.922213] env[65222]: INFO networking_nsxv3.common.synchronization [req-f67b6cea-6265-4c83-90d2-be34aa1f6f94 req-ba0abf48-746e-4af8-b3f7-e6b74b916273 tempest-ServerPasswordTestJSON-1049662665 tempest-ServerPasswordTestJSON-1049662665-project-member] Enqueued Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 657.922213] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 657.923037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.923339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.923536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.923900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.924208] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.924448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.924645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.924944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.925155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.925359] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.235795] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d8caf172-652a-41f7-92b3-75dd8909cb27 None None] Enqueued Resource ID: e028ac4d-a8e6-4cba-96f0-967127df918d with Priority: HIGHEST for action port [ 658.236087] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e028ac4d-a8e6-4cba-96f0-967127df918d with Priority: HIGHEST for action port [ 658.236518] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e028ac4d-a8e6-4cba-96f0-967127df918d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.236684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e028ac4d-a8e6-4cba-96f0-967127df918d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.236829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e028ac4d-a8e6-4cba-96f0-967127df918d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.238153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e028ac4d-a8e6-4cba-96f0-967127df918d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.238153] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e028ac4d-a8e6-4cba-96f0-967127df918d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.427527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.427710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.427782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.427993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.428137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.428387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.428513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.428560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.428714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.428792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.428878] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 already deleted. [ 658.429013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.672412] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: SUCCESS [ 658.672582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.742761] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e028ac4d-a8e6-4cba-96f0-967127df918d [ 658.742761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.742761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.742761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.742761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.742761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.742761] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e028ac4d-a8e6-4cba-96f0-967127df918d already deleted. [ 658.742761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e028ac4d-a8e6-4cba-96f0-967127df918d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.152229] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.152653] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-591" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.152653] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-591" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.152976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-591" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.153332] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.153514] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.153653] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.153917] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.154102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.154338] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.154521] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.154697] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.156013] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.156013] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.156013] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.156013] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.177464] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.177702] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.178010] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.178218] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-591" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.178929] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-dedfb65a-3cfe-45d9-ae52-1c10082afd33 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.179127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.179259] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.179609] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.179730] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedfb65a-3cfe-45d9-ae52-1c10082afd33',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.260233] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c in Status: SUCCESS [ 659.260756] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c deletion is rescheduled due to dependency. [ 659.260756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.684494] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.684494] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.684494] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.684941] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.685099] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.685301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port dedfb65a-3cfe-45d9-ae52-1c10082afd33 not found, creating... [ 659.685703] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.685929] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.686843] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.686843] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.686843] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.690396] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.690396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.690396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.690396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.690721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.690721] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: dedfb65a-3cfe-45d9-ae52-1c10082afd33 is going to be created. [ 659.716150] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.716150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.716150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.716150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.716150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.718598] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.050972] env[65222]: INFO networking_nsxv3.common.synchronization [None req-68447857-c4c5-4c0e-8d9e-6045400da99d None None] Enqueued Resource ID: 1819c523-d7d9-4ff9-b630-29754a5ea7da with Priority: HIGHEST for action port [ 660.050972] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1819c523-d7d9-4ff9-b630-29754a5ea7da with Priority: HIGHEST for action port [ 660.051135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1819c523-d7d9-4ff9-b630-29754a5ea7da taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.051450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1819c523-d7d9-4ff9-b630-29754a5ea7da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.051549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1819c523-d7d9-4ff9-b630-29754a5ea7da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.051817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1819c523-d7d9-4ff9-b630-29754a5ea7da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.051898] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1819c523-d7d9-4ff9-b630-29754a5ea7da',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.071224] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2054f753-e63f-4db6-93ff-e5980fd621ff None None] Enqueued Resource ID: 61bbeb6b-a7ad-4418-8b88-e629cdef6a87 with Priority: HIGHEST for action port [ 660.071459] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61bbeb6b-a7ad-4418-8b88-e629cdef6a87 with Priority: HIGHEST for action port [ 660.073249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-61bbeb6b-a7ad-4418-8b88-e629cdef6a87 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.073249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61bbeb6b-a7ad-4418-8b88-e629cdef6a87" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.073249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61bbeb6b-a7ad-4418-8b88-e629cdef6a87" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.076050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61bbeb6b-a7ad-4418-8b88-e629cdef6a87" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.076050] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61bbeb6b-a7ad-4418-8b88-e629cdef6a87',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.546915] env[65222]: INFO networking_nsxv3.common.synchronization [req-8a5c3cd0-4c6b-4a70-a4d1-10cf8bfbece7 req-be20343f-eb20-4039-937a-eceb9dd87419 tempest-DeleteServersAdminTestJSON-1564260038 tempest-DeleteServersAdminTestJSON-1564260038-project-member] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 660.546915] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 660.546915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.546915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.547421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.549090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.549265] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.549415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.549493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.549677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.549791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.549905] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.555222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1819c523-d7d9-4ff9-b630-29754a5ea7da [ 660.556538] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.556538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.556538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.559023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.559229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.559428] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1819c523-d7d9-4ff9-b630-29754a5ea7da already deleted. [ 660.559527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1819c523-d7d9-4ff9-b630-29754a5ea7da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.562646] env[65222]: INFO networking_nsxv3.common.synchronization [req-f67b6cea-6265-4c83-90d2-be34aa1f6f94 req-ea3c6e68-74dd-4701-be9a-4e9adb70f395 service nova] Enqueued Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_rules [ 660.562646] env[65222]: INFO networking_nsxv3.common.synchronization [req-f67b6cea-6265-4c83-90d2-be34aa1f6f94 req-ea3c6e68-74dd-4701-be9a-4e9adb70f395 service nova] Enqueued Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 660.562646] env[65222]: INFO networking_nsxv3.common.synchronization [req-f67b6cea-6265-4c83-90d2-be34aa1f6f94 req-ea3c6e68-74dd-4701-be9a-4e9adb70f395 service nova] Enqueued Resource ID: dedfb65a-3cfe-45d9-ae52-1c10082afd33 with Priority: HIGHEST for action port [ 660.562775] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_rules [ 660.562901] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 660.563396] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dedfb65a-3cfe-45d9-ae52-1c10082afd33 with Priority: HIGHEST for action port [ 660.563782] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.563886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.563937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.564603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.564603] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.567554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.567878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.567878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.568009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.568194] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.568342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.568403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.568595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.568692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.568790] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.569705] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-dedfb65a-3cfe-45d9-ae52-1c10082afd33 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.569809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.570435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.570435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.570435] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedfb65a-3cfe-45d9-ae52-1c10082afd33',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.578333] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61bbeb6b-a7ad-4418-8b88-e629cdef6a87 [ 660.578929] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.578929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.578929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.579169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.579169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.579256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61bbeb6b-a7ad-4418-8b88-e629cdef6a87 already deleted. [ 660.579256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61bbeb6b-a7ad-4418-8b88-e629cdef6a87" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.897605] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.897605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.897605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.897605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.897605] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.897605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.897605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.898440] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.898737] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.899075] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.899306] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.899513] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.901834] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.901834] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.901834] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.901834] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.921779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.921779] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.921779] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.921779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.921779] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-1f408b6f-76e0-4399-bb28-feb1431d8d8e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.922088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.922088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.923595] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924162] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f408b6f-76e0-4399-bb28-feb1431d8d8e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.056434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.056434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.056434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.057744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.058154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.058154] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be updated. [ 661.072530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.072669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.078255] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.079395] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dedfb65a-3cfe-45d9-ae52-1c10082afd33 with status ACTIVE [ 661.080525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.080644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.080728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.083017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dedfb65a-3cfe-45d9-ae52-1c10082afd33 is going to be updated. [ 661.094828] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.095216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.095278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.095611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.095768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.108586] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.109606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.109606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.111620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.111620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.111620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dedfb65a-3cfe-45d9-ae52-1c10082afd33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.111620] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 661.433031] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.433251] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.433489] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.433692] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.433827] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.433974] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 1f408b6f-76e0-4399-bb28-feb1431d8d8e not found, creating... [ 661.434274] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.435146] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.435146] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.435146] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.435146] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.435713] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.435713] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.435713] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.436766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.436930] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.437100] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 1f408b6f-76e0-4399-bb28-feb1431d8d8e is going to be created. [ 661.461304] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.461496] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.461636] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.461929] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.462196] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.462421] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.586042] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.088376] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.088518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.088583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.088794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.088882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.088981] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 is going to be created. [ 662.115283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.115435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.115526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.115732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.116041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.133234] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: UNINITIALIZED for 2s [ 662.450363] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a071dace-d586-4801-a786-277996069573 None None] Enqueued Resource ID: ac0f0a56-79f8-4544-823e-2504e4444fad with Priority: HIGHEST for action port [ 662.450943] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0f0a56-79f8-4544-823e-2504e4444fad with Priority: HIGHEST for action port [ 662.451406] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac0f0a56-79f8-4544-823e-2504e4444fad taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.451544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac0f0a56-79f8-4544-823e-2504e4444fad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.451626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac0f0a56-79f8-4544-823e-2504e4444fad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.451870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac0f0a56-79f8-4544-823e-2504e4444fad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.452020] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac0f0a56-79f8-4544-823e-2504e4444fad',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.584204] env[65222]: INFO networking_nsxv3.common.synchronization [req-8a5c3cd0-4c6b-4a70-a4d1-10cf8bfbece7 req-aa3e1624-d462-453d-ad2b-5dfba22a3bd8 service nova] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_rules [ 662.584642] env[65222]: INFO networking_nsxv3.common.synchronization [req-8a5c3cd0-4c6b-4a70-a4d1-10cf8bfbece7 req-aa3e1624-d462-453d-ad2b-5dfba22a3bd8 service nova] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 662.584642] env[65222]: INFO networking_nsxv3.common.synchronization [req-8a5c3cd0-4c6b-4a70-a4d1-10cf8bfbece7 req-aa3e1624-d462-453d-ad2b-5dfba22a3bd8 service nova] Enqueued Resource ID: 1f408b6f-76e0-4399-bb28-feb1431d8d8e with Priority: HIGHEST for action port [ 662.584772] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_rules [ 662.584938] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 662.584938] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f408b6f-76e0-4399-bb28-feb1431d8d8e with Priority: HIGHEST for action port [ 662.587857] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.587857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.587857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.587857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.587857] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.587857] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.587857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.587857] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f408b6f-76e0-4399-bb28-feb1431d8d8e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.587857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.588717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.588717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.588717] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f408b6f-76e0-4399-bb28-feb1431d8d8e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.655090] env[65222]: INFO networking_nsxv3.common.synchronization [req-cbea62c7-0167-412e-a849-3760c6e7dc0b req-8a913954-11e0-440d-a1e4-4361a5b0608f tempest-FloatingIPsAssociationTestJSON-1856813460 tempest-FloatingIPsAssociationTestJSON-1856813460-project-member] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 662.655090] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 662.658663] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.658797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.658856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.659172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.661018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.661018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.661018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.661018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.661018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.661018] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.955229] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac0f0a56-79f8-4544-823e-2504e4444fad [ 662.956369] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.956369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.956369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.956604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.956647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.956744] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac0f0a56-79f8-4544-823e-2504e4444fad already deleted. [ 662.956826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac0f0a56-79f8-4544-823e-2504e4444fad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.055558] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.055558] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.055558] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.056128] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.056128] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.056128] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.056439] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.056719] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.056921] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.056921] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.057058] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.057813] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.057813] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.057813] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.057813] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.057813] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.084543] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.084543] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.084543] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.084543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.084543] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b1f86c60-a412-4f5a-b570-a1424a3a901f taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.084543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.084543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.084543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.084543] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f86c60-a412-4f5a-b570-a1424a3a901f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.091033] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f408b6f-76e0-4399-bb28-feb1431d8d8e with status ACTIVE [ 663.091575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.091575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.091575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.091777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.091777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.091923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.092034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.092275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.092347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.092401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.092629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.093075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.093075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.093075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.093215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.093215] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f408b6f-76e0-4399-bb28-feb1431d8d8e is going to be updated. [ 663.095287] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.095287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.121761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.121909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.121983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.122198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.122335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.122497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f408b6f-76e0-4399-bb28-feb1431d8d8e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.124637] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 663.124807] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 deletion is rescheduled due to dependency. [ 663.124906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125928] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.163034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.163034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.163034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.163452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.163452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.163452] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe already deleted. [ 663.163452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589597] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.589597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.589597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.589597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.589597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b1f86c60-a412-4f5a-b570-a1424a3a901f not found, creating... [ 663.590526] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.592020] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.592020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.592894] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.593194] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.595023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b1f86c60-a412-4f5a-b570-a1424a3a901f is going to be created. [ 663.619853] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.619853] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.619853] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.663166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.663166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.663166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.663166] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.130295] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.146606] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: SUCCESS [ 664.146606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.146606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.149065] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.149065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.149065] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.471998] env[65222]: INFO networking_nsxv3.common.synchronization [req-cbea62c7-0167-412e-a849-3760c6e7dc0b req-8cd6c39d-706b-4591-8ecd-b5feed11b7ba service nova] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_rules [ 664.472243] env[65222]: INFO networking_nsxv3.common.synchronization [req-cbea62c7-0167-412e-a849-3760c6e7dc0b req-8cd6c39d-706b-4591-8ecd-b5feed11b7ba service nova] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 664.472382] env[65222]: INFO networking_nsxv3.common.synchronization [req-cbea62c7-0167-412e-a849-3760c6e7dc0b req-8cd6c39d-706b-4591-8ecd-b5feed11b7ba service nova] Enqueued Resource ID: b1f86c60-a412-4f5a-b570-a1424a3a901f with Priority: HIGHEST for action port [ 664.472996] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_rules [ 664.473164] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 664.473266] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f86c60-a412-4f5a-b570-a1424a3a901f with Priority: HIGHEST for action port [ 664.473559] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.473985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.473985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.474318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.474318] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.475097] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.475271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.475326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.475634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.475634] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.475780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.475780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.475982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.476040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.476118] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.476919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f86c60-a412-4f5a-b570-a1424a3a901f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.477068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.477228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.477289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.477350] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f86c60-a412-4f5a-b570-a1424a3a901f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.633812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.634262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.634262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.634262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.634460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.634562] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be updated. [ 664.650516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.650704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.650777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.651040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.651212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.651311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.651379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.651557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.651646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.651736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.651899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.651994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.652180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.652245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.652346] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.652438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.652498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.652637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.652725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.652809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.652897] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.667611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.667611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.667611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.667611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.667611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.677937] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 664.980221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.980389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.980537] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.982120] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f86c60-a412-4f5a-b570-a1424a3a901f with status ACTIVE [ 664.982120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.982120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.982120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.982120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.983402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.983899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.984048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.984119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.984305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.984392] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.984598] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.984699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.985816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.985816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.985816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.985816] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f86c60-a412-4f5a-b570-a1424a3a901f is going to be updated. [ 665.017902] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.018523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.018523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.018710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.019126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.019126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f86c60-a412-4f5a-b570-a1424a3a901f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.087449] env[65222]: INFO networking_nsxv3.common.synchronization [req-16038e51-2540-42c2-8c3e-10150c28e890 req-6f6b37ce-0184-4219-a01f-00cf89843aec tempest-InstanceActionsTestJSON-246261609 tempest-InstanceActionsTestJSON-246261609-project-member] Enqueued Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 665.088599] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 665.091019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.091019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.091019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.091019] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.157752] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29dbf536-ddd1-4cbf-a358-4d4757551b70: rpc.has_security_group_logging(os_id): False [ 665.186639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.186785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.186863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.187116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.187207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.187425] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.187525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.187588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.187744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.187819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.187995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.188121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.188167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.188297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.188446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.189533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.189533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.189533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.189533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.189533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.189533] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 is going to be created. [ 665.270641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.270915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.270915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.271444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.271444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.293788] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: IN_PROGRESS for 2s [ 665.487980] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.595155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.595595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.595764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.596088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.596189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.596602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.596961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.597061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.597156] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 already deleted. [ 665.597241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.992079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.992573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.992573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.992573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.992796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.992796] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be created. [ 666.032030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.032030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.032030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.032030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.032030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.050091] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: UNINITIALIZED for 2s [ 666.380866] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.381074] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-535" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.381861] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-535" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.381861] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-535" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.381861] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.382109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.382109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.382255] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.382389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.382590] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.382695] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.382800] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.382936] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.383067] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.383169] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.383295] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.403610] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.403788] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.404668] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.404668] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-535" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.404668] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-d5608396-2778-4b1b-af97-3ab42a6c21a8 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.404668] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.404967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.405257] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.405404] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5608396-2778-4b1b-af97-3ab42a6c21a8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.691890] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 666.692140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.693216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.693216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693632] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.908582] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.908814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.908971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.909330] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.909521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.909672] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port d5608396-2778-4b1b-af97-3ab42a6c21a8 not found, creating... [ 666.909945] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.910205] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.910311] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.910611] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.910748] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.911406] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.911648] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.911773] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.912027] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.912160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.912336] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: d5608396-2778-4b1b-af97-3ab42a6c21a8 is going to be created. [ 666.934450] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.934740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.934791] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.935077] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.935291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.935504] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.199156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.199156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.199156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.199156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.199156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.199995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.199995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.199995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.199995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.199995] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.306985] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: SUCCESS [ 667.306985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.483174] env[65222]: INFO networking_nsxv3.common.synchronization [req-556fd644-b03c-4a60-9921-fd34633d44a8 req-b840b9d8-f1c5-4f70-8147-090f4f411ea7 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 667.483709] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 667.484048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.484192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.484259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.484432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.484969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.484969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.484969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.485254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.485254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.485254] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.504020] env[65222]: INFO networking_nsxv3.common.synchronization [req-556fd644-b03c-4a60-9921-fd34633d44a8 req-b840b9d8-f1c5-4f70-8147-090f4f411ea7 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 667.504319] env[65222]: INFO networking_nsxv3.common.synchronization [req-556fd644-b03c-4a60-9921-fd34633d44a8 req-b840b9d8-f1c5-4f70-8147-090f4f411ea7 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 667.504658] env[65222]: INFO networking_nsxv3.common.synchronization [req-556fd644-b03c-4a60-9921-fd34633d44a8 req-b840b9d8-f1c5-4f70-8147-090f4f411ea7 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 667.504939] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 667.505042] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 667.505319] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 667.505415] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.505530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.505592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.505789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.505869] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.506831] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.506934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.507139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b82d1fa3-c300-40f8-9317-540c277089c0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.507243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.507307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.507487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.507588] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82d1fa3-c300-40f8-9317-540c277089c0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.643587] env[65222]: INFO networking_nsxv3.common.synchronization [req-16038e51-2540-42c2-8c3e-10150c28e890 req-1ea33783-3828-4fcc-ab3c-227a257fb8ef service nova] Enqueued Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_rules [ 667.643985] env[65222]: INFO networking_nsxv3.common.synchronization [req-16038e51-2540-42c2-8c3e-10150c28e890 req-1ea33783-3828-4fcc-ab3c-227a257fb8ef service nova] Enqueued Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 667.643985] env[65222]: INFO networking_nsxv3.common.synchronization [req-16038e51-2540-42c2-8c3e-10150c28e890 req-1ea33783-3828-4fcc-ab3c-227a257fb8ef service nova] Enqueued Resource ID: d5608396-2778-4b1b-af97-3ab42a6c21a8 with Priority: HIGHEST for action port [ 667.645031] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_rules [ 667.645031] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 667.645031] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5608396-2778-4b1b-af97-3ab42a6c21a8 with Priority: HIGHEST for action port [ 667.645031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.645031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.645718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.646136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.646267] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.649752] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.649752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.649752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.649988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.649988] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.650121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.650121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.650221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.650313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.650417] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.651917] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5608396-2778-4b1b-af97-3ab42a6c21a8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.651917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.651917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.651917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.651917] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5608396-2778-4b1b-af97-3ab42a6c21a8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.701828] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53a4a97d-b980-4164-9506-aae26c06b4c1: rpc.has_security_group_logging(os_id): False [ 667.733026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.733026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.733026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.733026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.733778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.733778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.733778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.734381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.734381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.734381] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be updated. [ 667.820900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.820900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.820900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.820900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.820900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.838076] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 667.991457] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.010751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.010903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.013019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b82d1fa3-c300-40f8-9317-540c277089c0 with status ACTIVE [ 668.013275] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.013418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.013490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.013774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.013887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.014168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.014340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.014440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.014704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.014920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.015236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.015407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.015483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.015662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.015743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.015834] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b82d1fa3-c300-40f8-9317-540c277089c0 is going to be updated. [ 668.040481] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.041368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.041435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.041650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.041792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.041975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.063931] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 668.064282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.064553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.064909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.065210] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.065397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.065520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.065786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.065948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.066123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.066284] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.157315] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.158914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.159354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.159608] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5608396-2778-4b1b-af97-3ab42a6c21a8 with status ACTIVE [ 668.159830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.159980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.160086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.160340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.160440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.160624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.160726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.160792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.160961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.161103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.161344] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.161468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.161556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.161734] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.161842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.161954] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5608396-2778-4b1b-af97-3ab42a6c21a8 is going to be updated. [ 668.195342] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.195533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.195587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.197695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.197880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.198153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5608396-2778-4b1b-af97-3ab42a6c21a8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.373159] env[65222]: INFO networking_nsxv3.common.synchronization [req-ce15870d-7939-488b-88f0-414dcf1f6977 req-cd2a9d5d-ee05-4c28-af5e-66a7e0d9e452 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 668.374458] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 668.375507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.376164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.376294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.376532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.376842] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.376947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.377022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.377684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.377684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.377684] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.499553] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.568963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.569164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.569247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.569542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.569757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.569914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.569985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.570231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.570380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.570554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.573021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.573021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.573021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.573021] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.664798] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.881927] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.882143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.882215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.882646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.882811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.883291] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.883291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.883291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.883583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.883583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.883660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 668.937042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.937042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.937042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.937042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.937466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.952080] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 669.003385] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.003574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.003619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.004376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.004467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.004538] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 669.045441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.045612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.045673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.045941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.046554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.060609] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 669.075177] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 311b5750-44a1-4206-b22b-cccdf5cbdffe: rpc.has_security_group_logging(os_id): False [ 669.105434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.105434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.105998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.105998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.105998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.106324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.106481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.106540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.106809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.106973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.107605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.107790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.107916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.108267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.108462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.108837] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.109075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.109212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.109456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.109543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.109989] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be created. [ 669.167168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.167375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.167422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.167803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.167899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.168946] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 is going to be created. [ 669.187420] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.188223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.188223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.188223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.188223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.202543] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 669.206582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.206582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.206582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.206582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.206582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.218014] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: UNINITIALIZED for 2s [ 669.703024] env[65222]: INFO networking_nsxv3.common.synchronization [req-c7fa44e3-9fcc-4b5b-8aa7-d3a9414aea83 req-4a17e6c5-c3c6-41e1-9524-56da3a624fb2 tempest-ServersV294TestFqdnHostnames-1538117571 tempest-ServersV294TestFqdnHostnames-1538117571-project-member] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 669.703024] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGHEST for action security_group_members [ 669.703024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.703826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.704067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.704447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.704816] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.705251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.705532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.705944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.706225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.706520] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.859474] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 669.859742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.211036] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.211036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.211036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.211036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.211036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.211358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.211411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.212217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.212217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.212217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.212217] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 is going to be updated. [ 670.247659] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.247659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.247659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.247659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.247659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.258240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: IN_PROGRESS for 2s [ 670.967242] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 670.967517] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 670.967517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.072693] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 671.073075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.073358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.073669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.073983] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.074194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.074298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.074542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.074685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.074818] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.171128] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0b9fbc43-488d-4549-92fc-d0c6f9cc481f None None] Enqueued Resource ID: b9f16348-e81a-4c61-9b91-361d655de2fe with Priority: HIGHEST for action port [ 671.171128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9f16348-e81a-4c61-9b91-361d655de2fe with Priority: HIGHEST for action port [ 671.171365] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9f16348-e81a-4c61-9b91-361d655de2fe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.171484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9f16348-e81a-4c61-9b91-361d655de2fe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.171550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9f16348-e81a-4c61-9b91-361d655de2fe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.171960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9f16348-e81a-4c61-9b91-361d655de2fe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.172638] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f16348-e81a-4c61-9b91-361d655de2fe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.217327] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 671.217494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.231274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: SUCCESS [ 671.231274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.232125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.232764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.233128] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.234015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.234015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.234015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.234015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.234015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.234015] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.578602] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.678253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9f16348-e81a-4c61-9b91-361d655de2fe [ 671.678767] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.678925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.679043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.679283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.679412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.679520] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9f16348-e81a-4c61-9b91-361d655de2fe already deleted. [ 671.679603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9f16348-e81a-4c61-9b91-361d655de2fe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.737888] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.738622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.738796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.739162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.739511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.739649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.739946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.740082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.740207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.740371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.740809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.740809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.740975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.742101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.742356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.742526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.742621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.742853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.743108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.743196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.743416] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.082041] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.248015] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9f89604-a346-4b24-a7a6-2abb702a4055: rpc.has_security_group_logging(os_id): False [ 672.269667] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 in Status: SUCCESS [ 672.269945] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 deletion is rescheduled due to dependency. [ 672.270149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.271189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.271348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.274949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.274949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.274949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.274949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.274949] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 is going to be created. [ 672.351778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.352220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.352345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.353052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.353052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.369128] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: IN_PROGRESS for 2s [ 672.588076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.588076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.588076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.588076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.588076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.588076] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 672.627370] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.627592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.627664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.627831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.628270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.641596] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 674.385293] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: SUCCESS [ 674.385293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.664037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.664037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.664037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.664037] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.668948] env[65222]: INFO networking_nsxv3.common.synchronization [req-8f80c3ef-a4a3-44a7-88fc-a2a41ab59e3e req-018da6ce-8dcb-4870-9090-a3a598f2d26f tempest-VolumesAdminNegativeTest-1562226656 tempest-VolumesAdminNegativeTest-1562226656-project-member] Enqueued Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 674.669820] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGHEST for action security_group_members [ 674.670439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.672636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.672636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.672636] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.168253] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.177598] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.177598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.177598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.178011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.178011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178106] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.178196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.178259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.178420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.178588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 is going to be updated. [ 675.212275] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.212275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.212275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.212275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.212275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.226779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: IN_PROGRESS for 2s [ 675.671256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7654edec-ade1-480e-832c-a02879a9e17c: rpc.has_security_group_logging(os_id): False [ 675.691439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.691622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.691759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.691874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.691967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.692226] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.692337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.692403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.692564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.692643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.692731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 675.770633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.770789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.770858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.771107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.771343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.793469] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 676.407412] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e25c67ff-65f9-4c7e-abdf-a229794b3a6e None None] Enqueued Resource ID: ac03f6d6-c33d-4ab0-8827-0380a979a266 with Priority: HIGHEST for action port [ 676.408167] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac03f6d6-c33d-4ab0-8827-0380a979a266 with Priority: HIGHEST for action port [ 676.409028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac03f6d6-c33d-4ab0-8827-0380a979a266 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.409028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac03f6d6-c33d-4ab0-8827-0380a979a266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.409028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac03f6d6-c33d-4ab0-8827-0380a979a266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.409267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac03f6d6-c33d-4ab0-8827-0380a979a266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.409267] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac03f6d6-c33d-4ab0-8827-0380a979a266',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.912711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac03f6d6-c33d-4ab0-8827-0380a979a266 [ 676.913040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.913316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.913316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.913454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.913454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.913559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac03f6d6-c33d-4ab0-8827-0380a979a266 already deleted. [ 676.913652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac03f6d6-c33d-4ab0-8827-0380a979a266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.242262] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 in Status: SUCCESS [ 677.246074] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 deletion is rescheduled due to dependency. [ 677.246074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.807489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 677.807489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.459338] env[65222]: INFO networking_nsxv3.common.synchronization [None req-cb0bfdba-a321-4fda-a511-8eb321bcd90f None None] Enqueued Resource ID: 66c6626b-8f3a-4468-aba3-abd067429e1e with Priority: HIGHEST for action port [ 678.460547] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c6626b-8f3a-4468-aba3-abd067429e1e with Priority: HIGHEST for action port [ 678.461120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-66c6626b-8f3a-4468-aba3-abd067429e1e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.461691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66c6626b-8f3a-4468-aba3-abd067429e1e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.461691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66c6626b-8f3a-4468-aba3-abd067429e1e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.463993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66c6626b-8f3a-4468-aba3-abd067429e1e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.463993] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66c6626b-8f3a-4468-aba3-abd067429e1e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.966402] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66c6626b-8f3a-4468-aba3-abd067429e1e [ 678.966663] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.966801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.966854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.969081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.969081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.969081] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66c6626b-8f3a-4468-aba3-abd067429e1e already deleted. [ 678.969081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66c6626b-8f3a-4468-aba3-abd067429e1e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.967638] env[65222]: INFO networking_nsxv3.common.synchronization [None req-9c373aae-c12a-463d-a714-6cabf720e448 None None] Enqueued Resource ID: 38e1f448-b7d7-4a69-85f2-319d7a44ffa3 with Priority: HIGHEST for action port [ 679.967638] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e1f448-b7d7-4a69-85f2-319d7a44ffa3 with Priority: HIGHEST for action port [ 679.968041] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e1f448-b7d7-4a69-85f2-319d7a44ffa3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.968931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e1f448-b7d7-4a69-85f2-319d7a44ffa3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.968931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e1f448-b7d7-4a69-85f2-319d7a44ffa3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e1f448-b7d7-4a69-85f2-319d7a44ffa3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970479] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e1f448-b7d7-4a69-85f2-319d7a44ffa3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.471785] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38e1f448-b7d7-4a69-85f2-319d7a44ffa3 [ 680.472226] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.472226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.472385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.472969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.472969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.472969] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38e1f448-b7d7-4a69-85f2-319d7a44ffa3 already deleted. [ 680.472969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e1f448-b7d7-4a69-85f2-319d7a44ffa3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.653994] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2bcb3ff8-cecb-415d-8e8e-0a8471edba4b None None] Enqueued Resource ID: 607e57dd-13da-4ced-a1c9-978f0020d34f with Priority: HIGHEST for action port [ 680.653994] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 607e57dd-13da-4ced-a1c9-978f0020d34f with Priority: HIGHEST for action port [ 680.653994] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-607e57dd-13da-4ced-a1c9-978f0020d34f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.653994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-607e57dd-13da-4ced-a1c9-978f0020d34f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.653994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-607e57dd-13da-4ced-a1c9-978f0020d34f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.653994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-607e57dd-13da-4ced-a1c9-978f0020d34f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.653994] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('607e57dd-13da-4ced-a1c9-978f0020d34f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.726256] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c9ee086d-516f-42cb-9616-16eb301e83e2 None None] Enqueued Resource ID: 93fc9ef4-0d0f-4117-8c7e-a190c02cb859 with Priority: HIGHEST for action port [ 680.726896] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fc9ef4-0d0f-4117-8c7e-a190c02cb859 with Priority: HIGHEST for action port [ 680.727234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-93fc9ef4-0d0f-4117-8c7e-a190c02cb859 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.727375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93fc9ef4-0d0f-4117-8c7e-a190c02cb859" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.727473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93fc9ef4-0d0f-4117-8c7e-a190c02cb859" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.727783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93fc9ef4-0d0f-4117-8c7e-a190c02cb859" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.727868] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93fc9ef4-0d0f-4117-8c7e-a190c02cb859',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.158060] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 607e57dd-13da-4ced-a1c9-978f0020d34f [ 681.158060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.158468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.158468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.159439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.159644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.159816] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:607e57dd-13da-4ced-a1c9-978f0020d34f already deleted. [ 681.159948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-607e57dd-13da-4ced-a1c9-978f0020d34f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.232292] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93fc9ef4-0d0f-4117-8c7e-a190c02cb859 [ 681.233036] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.233036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.233036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.233036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.233348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.233348] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93fc9ef4-0d0f-4117-8c7e-a190c02cb859 already deleted. [ 681.233348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93fc9ef4-0d0f-4117-8c7e-a190c02cb859" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.375848] env[65222]: INFO networking_nsxv3.common.synchronization [req-c77ce587-1c22-44e7-a653-d24d26f9ce41 req-ebd4cad6-ba7c-44c0-a5f0-38de86e46a03 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 681.376701] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 681.377193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.378240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.378443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.378777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.379067] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.379290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.379430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.379730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.381042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.381525] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.397760] env[65222]: INFO networking_nsxv3.common.synchronization [req-c77ce587-1c22-44e7-a653-d24d26f9ce41 req-ebd4cad6-ba7c-44c0-a5f0-38de86e46a03 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 681.399370] env[65222]: INFO networking_nsxv3.common.synchronization [req-c77ce587-1c22-44e7-a653-d24d26f9ce41 req-ebd4cad6-ba7c-44c0-a5f0-38de86e46a03 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 681.399370] env[65222]: INFO networking_nsxv3.common.synchronization [req-c77ce587-1c22-44e7-a653-d24d26f9ce41 req-ebd4cad6-ba7c-44c0-a5f0-38de86e46a03 tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 681.399594] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_rules [ 681.399889] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 681.400051] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b82d1fa3-c300-40f8-9317-540c277089c0 with Priority: HIGHEST for action port [ 681.400861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.401092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.401377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.401611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.401793] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.402952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.403459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.404937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b82d1fa3-c300-40f8-9317-540c277089c0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.404937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.404937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.408222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.409524] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b82d1fa3-c300-40f8-9317-540c277089c0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.884559] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.912484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.912662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.913339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b82d1fa3-c300-40f8-9317-540c277089c0 with status ACTIVE [ 681.913631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.913812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.913914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.915145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.915145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.915145] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.915145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.915145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.915386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.915468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.915758] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.915906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.916009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.916241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.916357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.916728] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b82d1fa3-c300-40f8-9317-540c277089c0 is going to be updated. [ 681.946029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.946029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.946029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.946029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.946029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.946029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b82d1fa3-c300-40f8-9317-540c277089c0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.008646] env[65222]: INFO networking_nsxv3.common.synchronization [req-31ded8f2-4f4a-49d0-8c80-c16908119505 req-a96fa442-ba94-4dbc-8087-2e609f54d0f1 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 682.009475] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 682.009789] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.009915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.009995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.011167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.011630] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.011805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.011886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.012075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.012393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.012393] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.386853] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.517490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.517490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.517490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.517804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.517804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.518063] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.518177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.518251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.520126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.520126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.520126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff already deleted. [ 682.520126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.889998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.891498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.891498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.891498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.891498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.891498] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 682.922358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.922358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.922358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.922358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.922358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.938369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 683.173997] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.174294] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.174350] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.174746] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.174961] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.175162] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.175277] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.175506] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.175659] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.175863] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.175971] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.176098] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.176201] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.176304] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.176409] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.176603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.198020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.198182] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.198333] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.198796] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.199176] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199346] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199459] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.199902] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.200052] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d6fba6-cd8a-4fda-8fcd-7d5e58650467',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.376021] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d1a4a0da-64a1-4950-abba-5200ea4e6419 None None] Enqueued Resource ID: 88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a with Priority: HIGHEST for action port [ 683.376823] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a with Priority: HIGHEST for action port [ 683.377783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.379589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.379589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.379589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.379785] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.703167] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.703473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.703545] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.703836] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.703991] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.704164] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 not found, creating... [ 683.704415] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.704570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.704814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.705047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.705218] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.705496] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.705642] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.705750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.705949] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.707054] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.707220] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 is going to be created. [ 683.752970] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.753294] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.753482] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.753709] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.753941] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.754203] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.881893] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a [ 683.881994] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.882079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.882326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.882418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.882459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.882534] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a already deleted. [ 683.882615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88d74fb2-3b3c-4c56-b0ea-ec06efb3fb5a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.955461] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2a6867bb-3e0e-4dd0-91cd-891148636740 None None] Enqueued Resource ID: 46e9cb17-174a-46f7-be2e-5ca755183d3c with Priority: HIGHEST for action port [ 683.955747] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e9cb17-174a-46f7-be2e-5ca755183d3c with Priority: HIGHEST for action port [ 683.956329] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-46e9cb17-174a-46f7-be2e-5ca755183d3c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.956451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46e9cb17-174a-46f7-be2e-5ca755183d3c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.956518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46e9cb17-174a-46f7-be2e-5ca755183d3c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.956794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46e9cb17-174a-46f7-be2e-5ca755183d3c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.956886] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46e9cb17-174a-46f7-be2e-5ca755183d3c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.464339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46e9cb17-174a-46f7-be2e-5ca755183d3c [ 684.464339] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.464623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.464623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.464714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.464768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.464822] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46e9cb17-174a-46f7-be2e-5ca755183d3c already deleted. [ 684.464978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46e9cb17-174a-46f7-be2e-5ca755183d3c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.516317] env[65222]: INFO networking_nsxv3.common.synchronization [req-31ded8f2-4f4a-49d0-8c80-c16908119505 req-dcc3a8bb-0c12-46db-af4d-ebd2b52524f9 service nova] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 684.516508] env[65222]: INFO networking_nsxv3.common.synchronization [req-31ded8f2-4f4a-49d0-8c80-c16908119505 req-dcc3a8bb-0c12-46db-af4d-ebd2b52524f9 service nova] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 684.516669] env[65222]: INFO networking_nsxv3.common.synchronization [req-31ded8f2-4f4a-49d0-8c80-c16908119505 req-dcc3a8bb-0c12-46db-af4d-ebd2b52524f9 service nova] Enqueued Resource ID: b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 with Priority: HIGHEST for action port [ 684.517197] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_rules [ 684.518064] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 684.518211] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 with Priority: HIGHEST for action port [ 684.518575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.518707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.520290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.520290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.520290] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.521098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.521215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.521349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.521583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.521737] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.521838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.521902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.522067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.522153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.522241] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.523677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.523790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.523886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.524057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.524128] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d6fba6-cd8a-4fda-8fcd-7d5e58650467',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.949260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 684.949816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.949816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.949934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.950122] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.950284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.950284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.950759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.950759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.950759] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.026286] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.026442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.026722] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.028484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 with status ACTIVE [ 685.029043] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.029043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.029043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.029232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.029267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.033257] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.033446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.033509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.033859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.033859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.034058] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.034191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.034257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.034413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.034487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.034576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1d6fba6-cd8a-4fda-8fcd-7d5e58650467 is going to be updated. [ 685.058347] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.058652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.058652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.058735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.058954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.059358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d6fba6-cd8a-4fda-8fcd-7d5e58650467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.069591] env[65222]: INFO networking_nsxv3.common.synchronization [req-80fca1a4-4a99-47e3-9fbe-00d5f7a5877a req-5a2d9a32-0c6c-4d67-8f1e-1a63ff1febd8 tempest-ServerPasswordTestJSON-1049662665 tempest-ServerPasswordTestJSON-1049662665-project-member] Enqueued Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 685.070145] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGHEST for action security_group_members [ 685.070745] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.070885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.070945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.071797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.072462] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.072578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.072646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.072812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.072897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.072990] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.142902] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f34e4767-2b8d-44bf-b720-c12ec5965093 None None] Enqueued Resource ID: 0dea5fbf-62f9-422c-9946-61005f37d727 with Priority: HIGHEST for action port [ 685.145858] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea5fbf-62f9-422c-9946-61005f37d727 with Priority: HIGHEST for action port [ 685.145858] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dea5fbf-62f9-422c-9946-61005f37d727 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.145858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dea5fbf-62f9-422c-9946-61005f37d727" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.145858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dea5fbf-62f9-422c-9946-61005f37d727" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.145858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dea5fbf-62f9-422c-9946-61005f37d727" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.145858] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dea5fbf-62f9-422c-9946-61005f37d727',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.453794] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.465140] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a7826e9-a98a-4a15-a98a-96220c0d97fc req-6a52ccea-a820-4673-a501-1c9335aef8d0 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 685.465832] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 685.466422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.466731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.466816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.467041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.467206] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.467310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.467371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.467526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.467610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.467704] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.538426] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.557566] env[65222]: INFO networking_nsxv3.common.synchronization [req-9df20751-bca6-4ee2-b240-40d8a8ae5aaf req-400009bb-143c-4375-bdb8-443ff8e059df tempest-ImagesOneServerTestJSON-578215935 tempest-ImagesOneServerTestJSON-578215935-project-member] Enqueued Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 685.558075] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 685.558375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.558511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.558629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.558936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.559116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.559739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.559739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.559739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.559739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.559739] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.575422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.575593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.575662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.575872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.575964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.576780] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.576780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.576780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.576780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.576780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.577074] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 is going to be updated. [ 685.607578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.607578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.607578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.607904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.607904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.618319] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: IN_PROGRESS for 2s [ 685.648411] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dea5fbf-62f9-422c-9946-61005f37d727 [ 685.648411] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.648411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.648411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.648747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.648747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.648747] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dea5fbf-62f9-422c-9946-61005f37d727 already deleted. [ 685.648904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dea5fbf-62f9-422c-9946-61005f37d727" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.958440] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.970623] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.970888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.971034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.971354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.971504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.971804] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.971962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.972152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.972563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.972563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.972563] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 686.001360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.001556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.001655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.001909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.002156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.014229] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 686.032324] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.032324] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.032533] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.032821] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.034654] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.035374] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.035374] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.035515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.035628] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.035813] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.036867] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.037014] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.037118] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.038027] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.038027] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.038027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.044284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.044453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.044527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.044729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.044812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.044935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff is going to be created. [ 686.058285] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.058444] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.058634] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.058855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.059208] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-9f3e20af-cf56-4700-b604-102f86f66d4b taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.059402] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.059877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.060031] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3e20af-cf56-4700-b604-102f86f66d4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.061925] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.062200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.063615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.063798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.063895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.064110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.064216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.064280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.064425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.064499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.064587] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 already deleted. [ 686.064664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.074141] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.074328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.074402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.074568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.074725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.087808] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: UNINITIALIZED for 2s [ 686.466896] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.466896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.466896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.466896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.466896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.466896] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 686.500997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.500997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.501173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.501269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.501509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.512396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 686.523116] env[65222]: INFO networking_nsxv3.common.synchronization [req-3b1efcb0-cf44-44ee-9bed-dbd681d34080 req-7c5575c7-d12e-4b5f-956b-5a788216b2c2 tempest-ServerTagsTestJSON-1255512112 tempest-ServerTagsTestJSON-1255512112-project-member] Enqueued Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 686.523116] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 686.523116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.523116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.523116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.523811] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.563165] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.563662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.563905] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.564717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.565413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.565413] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 9f3e20af-cf56-4700-b604-102f86f66d4b not found, creating... [ 686.565668] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.565768] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.565903] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.566112] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.566292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.566854] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.567201] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.567481] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.567749] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.567915] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.568047] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 9f3e20af-cf56-4700-b604-102f86f66d4b is going to be created. [ 686.595926] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.596647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.596647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.596647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.596815] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.596949] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.991048] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-359 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.991358] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-359" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.991358] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-359" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.991970] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-359" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.991970] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.992117] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.992203] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.992408] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.992544] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.992744] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.992851] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.992952] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.993711] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.993711] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.993711] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.993711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.013489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.013597] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.013733] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.013905] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-359" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.014236] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-0d08809d-e4ec-4804-8120-b805058ca294 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.014429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.014531] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.014817] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.015592] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d08809d-e4ec-4804-8120-b805058ca294',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.025510] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.025730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.025807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.026019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.026143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.026694] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.027047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.027047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.027163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.027201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.027315] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d already deleted. [ 687.027405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.029486] env[65222]: INFO networking_nsxv3.common.synchronization [None req-dbd8f4b1-9da1-4b01-bb94-9aff98099355 None None] Enqueued Resource ID: 9cf02cc2-0fcb-46ee-ab86-bb51e596c155 with Priority: HIGHEST for action port [ 687.030491] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cf02cc2-0fcb-46ee-ab86-bb51e596c155 with Priority: HIGHEST for action port [ 687.030915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cf02cc2-0fcb-46ee-ab86-bb51e596c155 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.030915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cf02cc2-0fcb-46ee-ab86-bb51e596c155" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.031072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cf02cc2-0fcb-46ee-ab86-bb51e596c155" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.031443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cf02cc2-0fcb-46ee-ab86-bb51e596c155" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.031443] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cf02cc2-0fcb-46ee-ab86-bb51e596c155',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [req-9df20751-bca6-4ee2-b240-40d8a8ae5aaf req-98e59066-6fab-4791-9b60-409416def7ef service nova] Enqueued Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_rules [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [req-9df20751-bca6-4ee2-b240-40d8a8ae5aaf req-98e59066-6fab-4791-9b60-409416def7ef service nova] Enqueued Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [req-9df20751-bca6-4ee2-b240-40d8a8ae5aaf req-98e59066-6fab-4791-9b60-409416def7ef service nova] Enqueued Resource ID: 9f3e20af-cf56-4700-b604-102f86f66d4b with Priority: HIGHEST for action port [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_rules [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 687.359159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3e20af-cf56-4700-b604-102f86f66d4b with Priority: HIGHEST for action port [ 687.360904] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.360904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.360904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.363087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.363087] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.364029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.364690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.364690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.364690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.364690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.364690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.364939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.364939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.365050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.365152] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.368285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3e20af-cf56-4700-b604-102f86f66d4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.368285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.368285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.368285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.368285] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3e20af-cf56-4700-b604-102f86f66d4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.521205] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.521205] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.521205] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.521365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.522030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.522030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 0d08809d-e4ec-4804-8120-b805058ca294 not found, creating... [ 687.522030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.522248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.522248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.522461] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.522625] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.522974] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.523269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.523319] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.523536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.523671] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.523810] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 0d08809d-e4ec-4804-8120-b805058ca294 is going to be created. [ 687.534980] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cf02cc2-0fcb-46ee-ab86-bb51e596c155 [ 687.534980] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.535621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.535621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.535621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.535621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.535621] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cf02cc2-0fcb-46ee-ab86-bb51e596c155 already deleted. [ 687.535621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cf02cc2-0fcb-46ee-ab86-bb51e596c155" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.545564] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.545564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.545564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.545564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.546088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.546088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.632865] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 in Status: SUCCESS [ 687.632865] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 deletion is rescheduled due to dependency. [ 687.632865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.868354] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.870122] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.870257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.870443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3e20af-cf56-4700-b604-102f86f66d4b with status ACTIVE [ 687.870957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.871099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.871167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.871374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.871464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.871671] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.871740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.871795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.871969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.873227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.873842] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.873842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.874051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.874051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.874124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.874610] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3e20af-cf56-4700-b604-102f86f66d4b is going to be updated. [ 687.902612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.902612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.902612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.902612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.902612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.902612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3e20af-cf56-4700-b604-102f86f66d4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.024594] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 688.025016] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 deletion is rescheduled due to dependency. [ 688.025016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.100432] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: SUCCESS [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.100432] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.100432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.100432] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.312586] env[65222]: INFO networking_nsxv3.common.synchronization [req-3b1efcb0-cf44-44ee-9bed-dbd681d34080 req-15321c4f-b2e2-4ae6-9ccd-c999d121288f service nova] Enqueued Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_rules [ 688.312586] env[65222]: INFO networking_nsxv3.common.synchronization [req-3b1efcb0-cf44-44ee-9bed-dbd681d34080 req-15321c4f-b2e2-4ae6-9ccd-c999d121288f service nova] Enqueued Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 688.312586] env[65222]: INFO networking_nsxv3.common.synchronization [req-3b1efcb0-cf44-44ee-9bed-dbd681d34080 req-15321c4f-b2e2-4ae6-9ccd-c999d121288f service nova] Enqueued Resource ID: 0d08809d-e4ec-4804-8120-b805058ca294 with Priority: HIGHEST for action port [ 688.313132] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_rules [ 688.313132] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 688.313132] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d08809d-e4ec-4804-8120-b805058ca294 with Priority: HIGHEST for action port [ 688.313719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.313719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.313719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.314139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.315572] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.315572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.315572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.315572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.315572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.317040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.317624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.317624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.317624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.317624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.317783] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.322849] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d08809d-e4ec-4804-8120-b805058ca294 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.322942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.322991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.323187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.324466] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d08809d-e4ec-4804-8120-b805058ca294',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.372475] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.527301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 688.527301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.527739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.528318] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.528318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.528318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.528318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.528318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.528604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.528604] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.604714] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.827995] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.830253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.830337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.830709] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d08809d-e4ec-4804-8120-b805058ca294 with status ACTIVE [ 688.830806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.830882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.830882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.831141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.831230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.831400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.831508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.831571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.831722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.831798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.831979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.832427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.832507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.832652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.832728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.832813] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d08809d-e4ec-4804-8120-b805058ca294 is going to be updated. [ 688.863253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.863395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.863464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.864316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.864528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.864716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d08809d-e4ec-4804-8120-b805058ca294" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.874909] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.874909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.874909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.874909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.875251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.875251] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 is going to be created. [ 688.909249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.909249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.909249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.909703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.909747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.922992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: UNINITIALIZED for 2s [ 689.030729] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.109690] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a50b6578-c051-4750-b9bb-002f9ba016ff: rpc.has_security_group_logging(os_id): False [ 689.130426] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.130642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.130718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.131020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.131272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.131388] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.131530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.131586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.131745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.131888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.131967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff is going to be created. [ 689.204089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.204243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.204313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.204586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.204842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.220618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: IN_PROGRESS for 2s [ 689.334633] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.535269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7654edec-ade1-480e-832c-a02879a9e17c: rpc.has_security_group_logging(os_id): False [ 689.556906] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.560559] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.560559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.560559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 689.637203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.637444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.637504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.637730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.637909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.659560] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 689.724858] env[65222]: INFO networking_nsxv3.common.synchronization [None req-be8e9154-5dc9-40d1-a5b8-64acbccacf46 None None] Enqueued Resource ID: 92fd02ec-56c8-4d66-abcd-023bb5275a37 with Priority: HIGHEST for action port [ 689.724858] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fd02ec-56c8-4d66-abcd-023bb5275a37 with Priority: HIGHEST for action port [ 689.724858] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-92fd02ec-56c8-4d66-abcd-023bb5275a37 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.724858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92fd02ec-56c8-4d66-abcd-023bb5275a37" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.724858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92fd02ec-56c8-4d66-abcd-023bb5275a37" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.724858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92fd02ec-56c8-4d66-abcd-023bb5275a37" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.725686] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92fd02ec-56c8-4d66-abcd-023bb5275a37',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.838250] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.839819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.839966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.840186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.840379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.840379] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d is going to be created. [ 689.866936] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.867079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.867125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.867372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.867533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.880351] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: UNINITIALIZED for 2s [ 690.230054] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92fd02ec-56c8-4d66-abcd-023bb5275a37 [ 690.230418] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.230848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.231077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.231448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.231615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.231787] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92fd02ec-56c8-4d66-abcd-023bb5275a37 already deleted. [ 690.231932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92fd02ec-56c8-4d66-abcd-023bb5275a37" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.569943] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ef2dde73-c24c-4445-a0e1-92d9c59ba4e3 None None] Enqueued Resource ID: 1133ccde-98f8-4b75-9641-d92dd1f896dd with Priority: HIGHEST for action port [ 690.570518] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1133ccde-98f8-4b75-9641-d92dd1f896dd with Priority: HIGHEST for action port [ 690.573093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1133ccde-98f8-4b75-9641-d92dd1f896dd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.573093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1133ccde-98f8-4b75-9641-d92dd1f896dd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.573093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1133ccde-98f8-4b75-9641-d92dd1f896dd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.573093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1133ccde-98f8-4b75-9641-d92dd1f896dd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.573093] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1133ccde-98f8-4b75-9641-d92dd1f896dd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.817134] env[65222]: INFO networking_nsxv3.common.synchronization [req-ee3fa206-40bc-42c1-807d-5b879b587020 req-f985dc67-050f-4188-963b-9493f08e2cf1 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 690.818119] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 690.818614] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.818887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.819071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.819455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.819719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.819982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.820217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.820495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.821219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.821551] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.933416] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: SUCCESS [ 690.933416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.933626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.934312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.934312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.934312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.934312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.934312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.934841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.934841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.934841] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.075962] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1133ccde-98f8-4b75-9641-d92dd1f896dd [ 691.075962] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.075962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.075962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.075962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.075962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.075962] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1133ccde-98f8-4b75-9641-d92dd1f896dd already deleted. [ 691.075962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1133ccde-98f8-4b75-9641-d92dd1f896dd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.236246] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: SUCCESS [ 691.236916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.245048] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.245048] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.245369] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.245415] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.246552] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.246552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.246552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.246552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.246552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.246866] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.246866] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.246866] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.246987] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.247046] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.249115] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.249115] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.268986] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.269838] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.269838] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.269838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.269838] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-c60eade9-03c1-401d-b6bf-bad2fbd0897e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.270471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.270471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.270975] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.270975] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c60eade9-03c1-401d-b6bf-bad2fbd0897e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.324615] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.324792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.324792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.326198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.326198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.326198] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 691.352884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.353191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.353191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.357922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.357922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.366616] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 691.438889] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.439244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.439244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.439478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.439722] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.439841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.439904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.440168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.440305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.440412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.440581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.440680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.440744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.440902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.441058] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.441156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.441310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.441434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.441481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.441594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.441703] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.676809] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 691.677081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.773985] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.774272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.774607] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.774849] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.775069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.775293] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port c60eade9-03c1-401d-b6bf-bad2fbd0897e not found, creating... [ 691.775668] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.775930] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.776067] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.776867] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.777191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.779474] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.781032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.781185] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.781449] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.781591] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.781738] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: c60eade9-03c1-401d-b6bf-bad2fbd0897e is going to be created. [ 691.805279] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.805472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.805585] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.807845] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.807845] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.807845] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.892415] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: SUCCESS [ 691.892683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.892854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.893095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.893292] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.893407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.893472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.893623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.893698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.893800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.894178] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.944935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3: rpc.has_security_group_logging(os_id): False [ 691.974546] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.974765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.974765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.976144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.976144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.976144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.976839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.976839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.977851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.977851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.977851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.977851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.977851] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 is going to be created. [ 692.048078] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.048316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.048316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.048658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.048795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.068877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: IN_PROGRESS for 2s [ 692.194640] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c3b5342c-53ec-4862-9f87-6442e05db9e6 None None] Enqueued Resource ID: 33767b50-7ee5-4fb3-8603-4af7cadf97fa with Priority: HIGHEST for action port [ 692.195830] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33767b50-7ee5-4fb3-8603-4af7cadf97fa with Priority: HIGHEST for action port [ 692.195830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-33767b50-7ee5-4fb3-8603-4af7cadf97fa taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.196012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33767b50-7ee5-4fb3-8603-4af7cadf97fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.196012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33767b50-7ee5-4fb3-8603-4af7cadf97fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.196218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33767b50-7ee5-4fb3-8603-4af7cadf97fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.196285] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33767b50-7ee5-4fb3-8603-4af7cadf97fa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.397873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.398295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.398295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.398605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.398605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.398748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.398748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.399201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.400039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.400039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.400039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.400039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.400039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.400297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.400297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.400297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.400524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.400524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.400993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.401151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.401261] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.589478] env[65222]: INFO networking_nsxv3.common.synchronization [req-ee3fa206-40bc-42c1-807d-5b879b587020 req-d813f4b7-f1c7-4352-bf81-3bab3cb189de service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 692.589711] env[65222]: INFO networking_nsxv3.common.synchronization [req-ee3fa206-40bc-42c1-807d-5b879b587020 req-d813f4b7-f1c7-4352-bf81-3bab3cb189de service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 692.589796] env[65222]: INFO networking_nsxv3.common.synchronization [req-ee3fa206-40bc-42c1-807d-5b879b587020 req-d813f4b7-f1c7-4352-bf81-3bab3cb189de service nova] Enqueued Resource ID: c60eade9-03c1-401d-b6bf-bad2fbd0897e with Priority: HIGHEST for action port [ 692.590759] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 692.590890] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 692.591037] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60eade9-03c1-401d-b6bf-bad2fbd0897e with Priority: HIGHEST for action port [ 692.591435] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.591556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.591651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.591967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.592156] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.594040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.594040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.594040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c60eade9-03c1-401d-b6bf-bad2fbd0897e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.594262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.594354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.594499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.594577] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c60eade9-03c1-401d-b6bf-bad2fbd0897e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.699563] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33767b50-7ee5-4fb3-8603-4af7cadf97fa [ 692.699563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.699563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.699563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.699563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.699563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.699563] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33767b50-7ee5-4fb3-8603-4af7cadf97fa already deleted. [ 692.699563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33767b50-7ee5-4fb3-8603-4af7cadf97fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.904512] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f008b7-879d-4427-a2d5-c69aea80237d: rpc.has_security_group_logging(os_id): False [ 692.929982] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.929982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.930129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.931050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.931050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.931050] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.931050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.931415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.931415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.931415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.931624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.932026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.932026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.932026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.932491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.932753] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.932933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.933082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.933357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.933473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.933591] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d is going to be created. [ 693.042206] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.042413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.042629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.042978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.043277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.055743] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: IN_PROGRESS for 2s [ 693.100642] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c60eade9-03c1-401d-b6bf-bad2fbd0897e with status ACTIVE [ 693.100642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.100642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.100642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.100642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.100642] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c60eade9-03c1-401d-b6bf-bad2fbd0897e is going to be updated. [ 693.104302] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.109388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.149493] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.149493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.149493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.149890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.150041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.150214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c60eade9-03c1-401d-b6bf-bad2fbd0897e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.381033] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 693.381033] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.381033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.381033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.381033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.884507] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.084060] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: SUCCESS [ 694.084199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.122428] env[65222]: INFO networking_nsxv3.common.synchronization [req-18747ba3-5d02-45d5-9354-2b077a1c1a4e req-e453e9e8-08ee-4f4f-932c-57619baa5e20 tempest-DeleteServersAdminTestJSON-1564260038 tempest-DeleteServersAdminTestJSON-1564260038-project-member] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 694.123189] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGHEST for action security_group_members [ 694.123409] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.123716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.123716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.123716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.123897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.123968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.126523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.126523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.126523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.126523] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.394021] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.632025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.632025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.632025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.632025] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be updated. [ 694.640245] env[65222]: INFO networking_nsxv3.common.synchronization [req-cb4e1cac-53db-4d86-8953-b871c45c618b req-ee30ee69-bff6-4381-a183-7255a2ea827c tempest-AttachInterfacesUnderV243Test-1274683289 tempest-AttachInterfacesUnderV243Test-1274683289-project-member] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 694.641134] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGHEST for action security_group_members [ 694.643300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.643845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.644103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.644588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.644978] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.645277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.645471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.646749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.647057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.647315] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.670098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.670098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.670098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.670098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.670491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.685117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: IN_PROGRESS for 2s [ 694.894725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.894725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.894725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.895195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.895402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.895685] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 694.917280] env[65222]: INFO networking_nsxv3.common.synchronization [None req-aa64da1f-a5d9-40e5-b1cd-8784856267c6 None None] Enqueued Resource ID: 3d5817f9-0686-4a4b-84bb-c746f13b79b0 with Priority: HIGHEST for action port [ 694.918069] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5817f9-0686-4a4b-84bb-c746f13b79b0 with Priority: HIGHEST for action port [ 694.918669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d5817f9-0686-4a4b-84bb-c746f13b79b0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.918774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d5817f9-0686-4a4b-84bb-c746f13b79b0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.919033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d5817f9-0686-4a4b-84bb-c746f13b79b0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.919232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d5817f9-0686-4a4b-84bb-c746f13b79b0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.919404] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5817f9-0686-4a4b-84bb-c746f13b79b0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.935209] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.935209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.937021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.937021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.937021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.948253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 695.075443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: SUCCESS [ 695.075736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.153592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.153592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.153592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.153592] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be updated. [ 695.183496] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.183637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.184326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.184326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.184326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.211432] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: IN_PROGRESS for 2s [ 695.422027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d5817f9-0686-4a4b-84bb-c746f13b79b0 [ 695.422307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.422446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.422518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.422737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.422830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.422924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d5817f9-0686-4a4b-84bb-c746f13b79b0 already deleted. [ 695.423241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d5817f9-0686-4a4b-84bb-c746f13b79b0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.557523] env[65222]: INFO networking_nsxv3.common.synchronization [req-7b5ad828-6b14-4b59-816a-e1a908edaede req-c0f29962-c400-4def-b437-c8ce76233600 tempest-ServersTestFqdnHostnames-1736055455 tempest-ServersTestFqdnHostnames-1736055455-project-member] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 696.558243] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGHEST for action security_group_members [ 696.558557] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.558736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.558812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.559020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.559189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.559299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.559360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.559579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.559697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.559697] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.696163] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 in Status: SUCCESS [ 696.696163] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 deletion is rescheduled due to dependency. [ 696.696261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.960504] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 696.963120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.963310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.963529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.963852] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.963852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.963999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.964048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.964152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.964252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.964545] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.064193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.064359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.064431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.064647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.064804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.065010] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.065107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.065175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.065338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.065415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.065512] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 is going to be updated. [ 697.103748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.103881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.103948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.104168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.104306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.125753] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: IN_PROGRESS for 2s [ 697.222312] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7654edec-ade1-480e-832c-a02879a9e17c in Status: SUCCESS [ 697.223778] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7654edec-ade1-480e-832c-a02879a9e17c deletion is rescheduled due to dependency. [ 697.223778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.470705] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.470869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.470961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.471184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.472125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.472125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.472125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.472125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.472125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.472125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.472125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.472436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.472436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.472488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.472672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.472804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.472892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.473100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.473217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.473347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.473500] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.646420] env[65222]: INFO networking_nsxv3.common.synchronization [req-5be3bb43-5520-4443-9b1f-d09cb960420c req-10da1c43-1fd5-4189-b9a3-4a5ac261b594 tempest-FloatingIPsAssociationNegativeTestJSON-1547376287 tempest-FloatingIPsAssociationNegativeTestJSON-1547376287-project-member] Enqueued Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 697.647492] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGHEST for action security_group_members [ 697.647870] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.647870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.648072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.648118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.648277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.648378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.648442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.648920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.648920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.648920] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.978165] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bedc55f5-0ad2-4b84-aab1-d26ca6737e7a: rpc.has_security_group_logging(os_id): False [ 698.004374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.004374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.004374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.005134] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.005134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.005684] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.005684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.005684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.005684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.005932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.005932] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.006086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.008089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.008089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.008089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.008089] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 698.097766] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.098031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.098031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.098346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.098346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.125129] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 698.151716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.151840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.152200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.152476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.152572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.152778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.152881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.152944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.153106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.153187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.153280] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c is going to be updated. [ 698.190844] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.190844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.190844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.191088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.191205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.206407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: IN_PROGRESS for 2s [ 698.643525] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e9a6f01-0298-40ee-861c-8432e2ebdec0 req-1e5bf4a2-0a2f-4555-a081-3058a83a7201 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 698.644066] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 698.644784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.644784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.644784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.644979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.644979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.645105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.645322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.645322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.645456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.645594] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.027254] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.027557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.027557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.028234] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.028462] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.028675] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.028840] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.029118] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.029316] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.029559] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.029951] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.029951] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.030058] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.030224] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.030261] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.030433] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.049481] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.049684] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.049863] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.050089] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.050662] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.050924] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.051097] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.051478] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.051665] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4cbac1-1d4b-412a-bfc0-3b1a8328de30',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.135829] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15ef4155-817c-4a1e-8484-6fde2baef247 in Status: SUCCESS [ 699.136021] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 deletion is rescheduled due to dependency. [ 699.136144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.147865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.148074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.148168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.148452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.148813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.148883] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.149016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.149106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.149303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.149402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.149513] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d already deleted. [ 699.149614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.554407] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.554878] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.555108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.555442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.555683] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.555933] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 not found, creating... [ 699.556408] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.556734] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.556972] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.557295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.557513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.557887] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.558219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.558423] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.558715] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.558984] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.559212] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 is going to be created. [ 699.583552] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.583552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.583552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.583874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.583874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.584153] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.141602] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 700.141602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.220220] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: IN_PROGRESS for 4s [ 700.298553] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2f46e119-08fc-450e-b438-6ff004cdb0ec tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: c708e45d-db46-4a44-ac4b-b08e7458c24a with Priority: HIGHEST for action security_group_rules [ 700.299226] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c708e45d-db46-4a44-ac4b-b08e7458c24a with Priority: HIGHEST for action security_group_rules [ 700.299527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c708e45d-db46-4a44-ac4b-b08e7458c24a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.299588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.299684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.300024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.301770] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c708e45d-db46-4a44-ac4b-b08e7458c24a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.446295] env[65222]: INFO networking_nsxv3.common.synchronization [None req-710eaf8a-c151-4e58-8531-4f512abf1916 tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: c708e45d-db46-4a44-ac4b-b08e7458c24a with Priority: HIGHEST for action security_group_rules [ 700.446295] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c708e45d-db46-4a44-ac4b-b08e7458c24a with Priority: HIGHEST for action security_group_rules [ 700.446295] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c708e45d-db46-4a44-ac4b-b08e7458c24a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.446721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e9a6f01-0298-40ee-861c-8432e2ebdec0 req-864c49a4-cd12-4ecc-99e5-f947039fdd03 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e9a6f01-0298-40ee-861c-8432e2ebdec0 req-864c49a4-cd12-4ecc-99e5-f947039fdd03 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e9a6f01-0298-40ee-861c-8432e2ebdec0 req-864c49a4-cd12-4ecc-99e5-f947039fdd03 service nova] Enqueued Resource ID: 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 with Priority: HIGHEST for action port [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 700.469140] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 with Priority: HIGHEST for action port [ 700.469658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.470108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.470336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.470796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.470992] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.472249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.472590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.472774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.473091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.474018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.474018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.474018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.474018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.474018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.474018] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.475211] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.475484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.475676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.479158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.479158] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4cbac1-1d4b-412a-bfc0-3b1a8328de30',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.827059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.827245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.827352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.828031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.828031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.828031] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c708e45d-db46-4a44-ac4b-b08e7458c24a already deleted. [ 700.828031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.828265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.828265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.828341] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c708e45d-db46-4a44-ac4b-b08e7458c24a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.980731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.981627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.981627] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.984578] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 with status ACTIVE [ 700.984578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.984578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.984578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.984578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.988213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.988213] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a4cbac1-1d4b-412a-bfc0-3b1a8328de30 is going to be updated. [ 701.015588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.015588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.015588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.015588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.015588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.015588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4cbac1-1d4b-412a-bfc0-3b1a8328de30" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.356491] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.356892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.356892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.356892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.357017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.357397] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c708e45d-db46-4a44-ac4b-b08e7458c24a already deleted. [ 701.357397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c708e45d-db46-4a44-ac4b-b08e7458c24a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.488998] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.994423] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.994591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.994966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.994966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.995073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.995099] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be created. [ 702.022987] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.023876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.023960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.024353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.024477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.037740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: UNINITIALIZED for 2s [ 702.235729] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac38280-989d-45d7-bcb9-03b71f69154c in Status: SUCCESS [ 702.235999] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c deletion is rescheduled due to dependency. [ 702.236633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.684432] env[65222]: INFO networking_nsxv3.common.synchronization [req-fea5a420-3b4f-4c75-82e3-0b79e4724707 req-0e2db023-f607-4441-b96c-987077915b5c tempest-ServersTestManualDisk-934677414 tempest-ServersTestManualDisk-934677414-project-member] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 702.685587] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGHEST for action security_group_members [ 702.685954] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.686172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.686252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.687449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.687631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.687750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.687832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.688033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.688498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.688649] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.193186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.193186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.193323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.194031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.194031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.194311] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.194456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.194543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.194883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.194883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.194990] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 is going to be updated. [ 703.227389] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.227556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.227660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.227952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.228165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.240314] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: IN_PROGRESS for 2s [ 703.583332] env[65222]: INFO networking_nsxv3.common.synchronization [req-3e1d40d9-1b98-4e9a-bdf9-a2b0c980ceb9 req-85a3602c-b7ff-4c44-ad85-14dc6e5e84b6 tempest-InstanceActionsTestJSON-246261609 tempest-InstanceActionsTestJSON-246261609-project-member] Enqueued Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 703.583941] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGHEST for action security_group_members [ 703.584916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.584916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.584916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.584916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.584916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.585182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.585182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.585624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.585624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.585624] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.050868] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 704.051233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.051338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.051595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.051813] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.051941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.052042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.052226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.052325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.052911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.052911] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.088687] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.088862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.088954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.089219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.089318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.089510] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.089609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.089672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.089832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.089902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.089985] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 is going to be updated. [ 704.123023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.123023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.123023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.123023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.123023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.140833] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: IN_PROGRESS for 2s [ 704.556330] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.556560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.556707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.557067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.557348] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.557497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.557598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.558021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.558021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.558105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.558233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.558333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.558413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.558616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.560048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.560048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.560048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.560048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.560048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.560048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.560048] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.067943] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 705.094113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.094551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.094678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.094928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.094992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.095325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.095691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.095691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.095691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.095824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.096052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.096269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.096342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.096491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.096559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.096976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.096976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.096976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.097194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.097531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.099117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be created. [ 705.184286] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.184286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.184968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.185401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.185745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.203222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 705.252451] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8b3202-aad0-4507-b032-c8b4d8908623 in Status: SUCCESS [ 705.252643] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 deletion is rescheduled due to dependency. [ 705.252790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.155390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f89604-a346-4b24-a7a6-2abb702a4055 in Status: SUCCESS [ 706.156321] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 deletion is rescheduled due to dependency. [ 706.156931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.223301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 707.223641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.584560] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 708.584960] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 711.498977] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f99b571b-923a-430f-ad71-0f35932120cf None None] Enqueued Resource ID: 7cb73953-6294-4ea9-a63c-e6a50788d192 with Priority: HIGHEST for action port [ 711.499750] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb73953-6294-4ea9-a63c-e6a50788d192 with Priority: HIGHEST for action port [ 711.500261] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cb73953-6294-4ea9-a63c-e6a50788d192 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.500364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cb73953-6294-4ea9-a63c-e6a50788d192" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.501435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cb73953-6294-4ea9-a63c-e6a50788d192" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.501435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cb73953-6294-4ea9-a63c-e6a50788d192" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.501435] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cb73953-6294-4ea9-a63c-e6a50788d192',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.004131] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cb73953-6294-4ea9-a63c-e6a50788d192 [ 712.004379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.004514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.004595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.004825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.004909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.005019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cb73953-6294-4ea9-a63c-e6a50788d192 already deleted. [ 712.005389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cb73953-6294-4ea9-a63c-e6a50788d192" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.324517] env[65222]: INFO networking_nsxv3.common.synchronization [req-442f21b2-cfbe-447d-b794-ef6c40e7de08 req-9da0548a-99c1-41c3-9e6f-c5a2e4eaeee7 tempest-ServerRescueTestJSON-1772520455 tempest-ServerRescueTestJSON-1772520455-project-member] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 712.325153] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 712.325437] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.325551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.325678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.325869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.326059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.326145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.326212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.326493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.326493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.326493] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.737162] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.737835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.737964] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.738321] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.738596] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.738751] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.738889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.739143] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.739282] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.739488] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.739642] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.739953] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.740074] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.740170] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.740278] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.740408] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.772367] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.772555] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.774856] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.776232] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.778766] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.778766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.778766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.778766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.778766] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bdbeee7-7874-46a1-9fdb-8a5a01a822c2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.829151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.829437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.829637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.829986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.830132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.830425] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.830566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.830709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.830933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.831421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.831421] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f already deleted. [ 712.831421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.283972] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.288023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 not found, creating... [ 713.288023] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.288023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.288473] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.288679] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 is going to be created. [ 713.325199] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.325444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.325588] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.325865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.326152] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.326414] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.837620] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c08991de-9e5f-4889-8d36-bee88675ed45 None None] Enqueued Resource ID: 5b35672c-4b55-4730-bec0-1fb134a6fbb8 with Priority: HIGHEST for action port [ 713.838186] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b35672c-4b55-4730-bec0-1fb134a6fbb8 with Priority: HIGHEST for action port [ 713.838490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b35672c-4b55-4730-bec0-1fb134a6fbb8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.838615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b35672c-4b55-4730-bec0-1fb134a6fbb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.838682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b35672c-4b55-4730-bec0-1fb134a6fbb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.839013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b35672c-4b55-4730-bec0-1fb134a6fbb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.839688] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b35672c-4b55-4730-bec0-1fb134a6fbb8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.009673] env[65222]: INFO networking_nsxv3.common.synchronization [req-442f21b2-cfbe-447d-b794-ef6c40e7de08 req-e09d5e17-55a6-4a39-85d6-3b679131bc14 service nova] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_rules [ 714.009945] env[65222]: INFO networking_nsxv3.common.synchronization [req-442f21b2-cfbe-447d-b794-ef6c40e7de08 req-e09d5e17-55a6-4a39-85d6-3b679131bc14 service nova] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 714.010182] env[65222]: INFO networking_nsxv3.common.synchronization [req-442f21b2-cfbe-447d-b794-ef6c40e7de08 req-e09d5e17-55a6-4a39-85d6-3b679131bc14 service nova] Enqueued Resource ID: 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 with Priority: HIGHEST for action port [ 714.010742] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_rules [ 714.010909] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 714.011628] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 with Priority: HIGHEST for action port [ 714.011961] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.012146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.012219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.012512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.012615] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.016393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.016393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.016393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.017031] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.019202] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.019202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.019202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.019202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.019202] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bdbeee7-7874-46a1-9fdb-8a5a01a822c2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.343788] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b35672c-4b55-4730-bec0-1fb134a6fbb8 [ 714.344216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.344481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.345503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.345603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.345698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.345976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b35672c-4b55-4730-bec0-1fb134a6fbb8 already deleted. [ 714.345976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b35672c-4b55-4730-bec0-1fb134a6fbb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.516434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.516913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.522502] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 with status ACTIVE [ 714.523120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.523120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.523259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.523536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.523685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.524748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.524748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.524748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.524748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.524748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.525579] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.525579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.525579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.525579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.525749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.526785] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bdbeee7-7874-46a1-9fdb-8a5a01a822c2 is going to be updated. [ 714.527658] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.553289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.553510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.553613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.554057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.554182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.554388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bdbeee7-7874-46a1-9fdb-8a5a01a822c2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.662544] env[65222]: INFO networking_nsxv3.common.synchronization [None req-729d26e5-0737-4d78-8c30-6a18b9deb560 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: f988adfd-8cb8-4866-9618-004234bae6ab with Priority: HIGHEST for action security_group_rules [ 714.662971] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f988adfd-8cb8-4866-9618-004234bae6ab with Priority: HIGHEST for action security_group_rules [ 714.664460] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f988adfd-8cb8-4866-9618-004234bae6ab taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.664460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.664460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.664460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.664460] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f988adfd-8cb8-4866-9618-004234bae6ab',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.854890] env[65222]: INFO networking_nsxv3.common.synchronization [None req-da967b2c-89e3-4a02-bda6-811c8f9e9e20 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: f988adfd-8cb8-4866-9618-004234bae6ab with Priority: HIGHEST for action security_group_rules [ 714.855653] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f988adfd-8cb8-4866-9618-004234bae6ab with Priority: HIGHEST for action security_group_rules [ 714.855653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f988adfd-8cb8-4866-9618-004234bae6ab taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.856688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.031288] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.186288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.186288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.186288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.186288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.186288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.186288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f988adfd-8cb8-4866-9618-004234bae6ab already deleted. [ 715.186288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.186631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.186631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.186631] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f988adfd-8cb8-4866-9618-004234bae6ab',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.242202] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-8ff63776-912f-4d4b-84e7-8ef2578129dd tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 715.243083] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 715.243466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.243611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.243691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.243977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.244230] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.244364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.244451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.244640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.244749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.244871] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.542031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.542031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.542031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.542031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.542031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.542031] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be created. [ 715.568956] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.569214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.569262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.569501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.569707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.588259] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: UNINITIALIZED for 2s [ 715.709552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.709702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.709775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.710067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.710170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.710271] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f988adfd-8cb8-4866-9618-004234bae6ab already deleted. [ 715.710355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f988adfd-8cb8-4866-9618-004234bae6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.748590] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.748590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.748590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.748998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.748998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.748998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.749123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.749185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.749556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.749684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.749785] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a already deleted. [ 715.749889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.910425] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.910721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.910721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.911171] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.911327] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.911502] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.911597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.911805] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.911939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.912252] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.912450] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.912592] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.912695] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.912797] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.912894] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.913581] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.935175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.936831] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.936831] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.936831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.936831] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-9493a304-30e5-432d-8a45-19055cf50871 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.936831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.936831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.937195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.937287] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9493a304-30e5-432d-8a45-19055cf50871',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.440034] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.440324] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.440494] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.440848] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.440985] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.441225] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 9493a304-30e5-432d-8a45-19055cf50871 not found, creating... [ 716.441594] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.441803] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.441967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.442246] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.442413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.442727] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.442973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.443093] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.443360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.443567] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.443749] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 9493a304-30e5-432d-8a45-19055cf50871 is going to be created. [ 716.466399] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.466399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.466399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.466672] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.466840] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.467123] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.783116] env[65222]: INFO networking_nsxv3.common.synchronization [req-a1c47222-54dc-4a6a-af16-a0094f6548bb req-be6d726f-3778-4bb1-8e70-28b0226d4148 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 716.783653] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 716.783945] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.784969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.784969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.785264] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.206619] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-41275d2a-68d2-4c3c-bf63-618172924327 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 717.206619] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-41275d2a-68d2-4c3c-bf63-618172924327 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 717.206619] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-41275d2a-68d2-4c3c-bf63-618172924327 service nova] Enqueued Resource ID: 9493a304-30e5-432d-8a45-19055cf50871 with Priority: HIGHEST for action port [ 717.207181] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 717.207347] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 717.207435] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9493a304-30e5-432d-8a45-19055cf50871 with Priority: HIGHEST for action port [ 717.207737] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.207869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.207940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.208767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.208900] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.209995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.210159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.210228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.210420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.210576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.210681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.213551] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.213551] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9493a304-30e5-432d-8a45-19055cf50871 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.213551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.213551] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9493a304-30e5-432d-8a45-19055cf50871',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.288177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.288177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.288177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.288763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.288763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.289474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.289474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.289474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.289474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.289735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.289779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 717.339067] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.339997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.340131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.340353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.340501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.350589] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 717.600173] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 717.600438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.600592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.601989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.602683] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.602683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.602683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.602683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.602683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.602963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.602963] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.677240] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-3fd7c093-3dc4-4529-a6b8-01611d4e728c tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 717.677889] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 717.678977] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.679177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.715049] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.716728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.716895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.717272] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9493a304-30e5-432d-8a45-19055cf50871 with status ACTIVE [ 717.717463] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.717595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.717667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.717872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.718337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.718337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.721867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.721994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.722228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.722322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.722537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.722644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.722713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.722921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.723021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.723117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9493a304-30e5-432d-8a45-19055cf50871 is going to be updated. [ 717.746334] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.746542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.746542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.746919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.747122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.747323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9493a304-30e5-432d-8a45-19055cf50871" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.078520] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.078690] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.078992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.079102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.079346] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.079488] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.080787] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.080787] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.080787] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.081066] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.081205] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.081309] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.081410] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.081515] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.081612] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.081735] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.100652] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.100804] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.101101] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.101295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.101601] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-75dcad38-d1c5-4b47-88e2-50526e767257 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.101762] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.102647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.102647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.102647] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75dcad38-d1c5-4b47-88e2-50526e767257',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.106915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.107187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.107187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.107380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.108262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.108601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.108684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.108749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.108939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.109036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.109472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.109472] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.219118] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.606280] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.606280] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.606280] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.606280] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.606280] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.606280] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 75dcad38-d1c5-4b47-88e2-50526e767257 not found, creating... [ 718.606594] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.606693] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.606736] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.606971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.607158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.607521] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.607748] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.607875] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.608363] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.608506] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.608641] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 75dcad38-d1c5-4b47-88e2-50526e767257 is going to be created. [ 718.610963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c338b2c-c780-410a-aac2-962f91390b3f: rpc.has_security_group_logging(os_id): False [ 718.632916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.633072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.633150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.633377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.633467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.633694] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.633817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.633887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.634091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.634172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.634350] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.634639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.634710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.634885] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.635515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.635515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.635515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.635515] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be created. [ 718.638785] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.639129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.639218] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.639920] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.640192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.640577] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.722775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.722990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.723104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.723347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.723549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.724832] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.724939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.725079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.725280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.725390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.725559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be created. [ 718.762600] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 718.799357] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.799517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.799517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.799724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.799958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.818035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: UNINITIALIZED for 2s [ 719.363624] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 719.364168] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 719.364168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.490475] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-b31b31eb-5161-43e8-bf28-a385f6855080 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 719.490652] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-b31b31eb-5161-43e8-bf28-a385f6855080 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 719.490782] env[65222]: INFO networking_nsxv3.common.synchronization [req-5331a330-4555-4cd3-846a-30755c639e1b req-b31b31eb-5161-43e8-bf28-a385f6855080 service nova] Enqueued Resource ID: 75dcad38-d1c5-4b47-88e2-50526e767257 with Priority: HIGHEST for action port [ 719.491460] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 719.491662] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 719.491858] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75dcad38-d1c5-4b47-88e2-50526e767257 with Priority: HIGHEST for action port [ 719.492181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.492292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.492531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.492605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.492807] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-75dcad38-d1c5-4b47-88e2-50526e767257 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.492926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.492994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.493230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.493315] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75dcad38-d1c5-4b47-88e2-50526e767257',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.999355] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75dcad38-d1c5-4b47-88e2-50526e767257 with status ACTIVE [ 720.000773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.000773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.000773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.000773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.001285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.001285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.001285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.001285] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75dcad38-d1c5-4b47-88e2-50526e767257 is going to be updated. [ 720.026060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.026240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.026569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.026872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.027111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.027353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75dcad38-d1c5-4b47-88e2-50526e767257" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.443669] env[65222]: INFO networking_nsxv3.common.synchronization [req-802ceab7-778d-456e-b1ba-30dce6089ba0 req-c11d66f8-c40e-4c4b-971d-724619736135 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 720.444845] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 720.445562] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.446861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.446861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.446861] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.775945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 720.776191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.830645] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.830645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.830645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.830645] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.876907] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.876907] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.876907] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.876907] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.876907] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.879236] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.879358] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.879721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.879770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.880047] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.880147] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.880210] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.880374] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.880432] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.880501] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.880642] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.902150] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.902150] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.902150] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.902150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.902150] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.902150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.902150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.902407] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.902407] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ba29cb-5b86-4802-8307-0dcb9aa4a5fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.952654] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.952983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.952983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.953202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.953354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.953618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.953618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.953753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.953824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.953906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.953906] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 already deleted. [ 720.953906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.334529] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.405562] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.406016] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.406095] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.406979] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.406979] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.406979] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb not found, creating... [ 721.407795] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.407795] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.407795] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.408339] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.408552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.409058] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.409306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.409463] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.409755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.410078] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.410360] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb is going to be created. [ 721.436948] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.438510] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.438652] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.439669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.439669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.439669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.837893] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.191928] env[65222]: INFO networking_nsxv3.common.synchronization [req-802ceab7-778d-456e-b1ba-30dce6089ba0 req-e0dedb62-988d-4eb6-a2cd-114b0308773a service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 722.191999] env[65222]: INFO networking_nsxv3.common.synchronization [req-802ceab7-778d-456e-b1ba-30dce6089ba0 req-e0dedb62-988d-4eb6-a2cd-114b0308773a service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 722.192122] env[65222]: INFO networking_nsxv3.common.synchronization [req-802ceab7-778d-456e-b1ba-30dce6089ba0 req-e0dedb62-988d-4eb6-a2cd-114b0308773a service nova] Enqueued Resource ID: 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb with Priority: HIGHEST for action port [ 722.193059] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 722.193201] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 722.193271] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb with Priority: HIGHEST for action port [ 722.193550] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.193697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.193802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.194100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.194189] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.195891] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.196062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.196138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.196325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.196508] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.196615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.196679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.197194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.197328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.197430] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.198240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.198615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.198615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.198615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.198767] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ba29cb-5b86-4802-8307-0dcb9aa4a5fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.341615] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.341615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.341615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.341825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.341854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.341957] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 722.374116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.374116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.374116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.374334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.374403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.385322] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 722.702732] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.702732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.702732] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.702732] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb with status ACTIVE [ 722.702732] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.702732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.702732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.702732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.702732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.703083] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.703083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.703083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.703186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.703212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.703371] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.703456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.703512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.703645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.703710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.703788] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12ba29cb-5b86-4802-8307-0dcb9aa4a5fb is going to be updated. [ 722.729152] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.730318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.730425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.730641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.730837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.731036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ba29cb-5b86-4802-8307-0dcb9aa4a5fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.207509] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.443668] env[65222]: INFO networking_nsxv3.common.synchronization [req-b20b72a0-f7eb-4f2d-9d46-5cc4c510fc18 req-bf338843-d338-432d-8287-26f9bfff02c8 tempest-InstanceActionsNegativeTestJSON-1307603883 tempest-InstanceActionsNegativeTestJSON-1307603883-project-member] Enqueued Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 723.444185] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 723.444554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.444680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.444757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.445528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.445761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.446041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.446117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.446310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.446393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.446506] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.709504] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.709772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.709772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.710100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.710173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.710267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be created. [ 723.749158] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.749158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.749158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.749158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.749158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.764924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: UNINITIALIZED for 2s [ 723.888599] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.889228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.889228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.889455] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.890297] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.890297] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.890578] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.890688] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.890855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.891124] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.891271] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.891400] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.891539] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.891673] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.891797] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.891953] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.917009] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.917293] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.917436] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.917810] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.918491] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-9040404f-803b-4756-832a-7bf350ad9013 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.918491] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.918491] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.919308] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.920165] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9040404f-803b-4756-832a-7bf350ad9013',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.952079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.952079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.952079] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e493ec04-5a13-467d-82fd-1b364368163b already deleted. [ 723.952079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.395712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 724.396296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.396296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.396540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.396540] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.396698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.396698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.396949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.396949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.397160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.397160] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.398013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.398193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.398340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.398500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.398500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.398661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.398749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.398839] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.423685] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.423963] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.424127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.424409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.424578] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.424726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 9040404f-803b-4756-832a-7bf350ad9013 not found, creating... [ 724.425102] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.425211] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.425248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.425510] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.425673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.426881] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.427147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.428041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.428041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.428041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.428238] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 9040404f-803b-4756-832a-7bf350ad9013 is going to be created. [ 724.455822] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.456191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.456330] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.456750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.457187] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.457505] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.902739] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.902874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.903261] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.184315] env[65222]: INFO networking_nsxv3.common.synchronization [req-b20b72a0-f7eb-4f2d-9d46-5cc4c510fc18 req-181e0738-0448-4b63-889e-3bdb8a51cffc service nova] Enqueued Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_rules [ 725.184464] env[65222]: INFO networking_nsxv3.common.synchronization [req-b20b72a0-f7eb-4f2d-9d46-5cc4c510fc18 req-181e0738-0448-4b63-889e-3bdb8a51cffc service nova] Enqueued Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 725.184551] env[65222]: INFO networking_nsxv3.common.synchronization [req-b20b72a0-f7eb-4f2d-9d46-5cc4c510fc18 req-181e0738-0448-4b63-889e-3bdb8a51cffc service nova] Enqueued Resource ID: 9040404f-803b-4756-832a-7bf350ad9013 with Priority: HIGHEST for action port [ 725.185397] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_rules [ 725.185397] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 725.185397] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9040404f-803b-4756-832a-7bf350ad9013 with Priority: HIGHEST for action port [ 725.185622] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.185745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.185811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.186096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.186181] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.187236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.187310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.187476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.187591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.187748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.187843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.187900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.188465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.188465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.188465] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.189877] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9040404f-803b-4756-832a-7bf350ad9013 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.189877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.189877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.189877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.189877] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9040404f-803b-4756-832a-7bf350ad9013',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.405217] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.691358] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.693304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.693304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.693304] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9040404f-803b-4756-832a-7bf350ad9013 with status ACTIVE [ 725.693304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.693304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.693304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.693617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.693617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.694760] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.694760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.694760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.694760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.695572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.695572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.695572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.695572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.695978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.696020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.696444] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9040404f-803b-4756-832a-7bf350ad9013 is going to be updated. [ 725.717782] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.718565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.718565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.718565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.720858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.720858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9040404f-803b-4756-832a-7bf350ad9013" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.781660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 725.781871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.782095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.784411] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.784411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.784411] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.909042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.909042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.909042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.909246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.909246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.909364] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 725.941756] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.943509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.943509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.943509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.943509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.956885] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 726.198374] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.234179] env[65222]: INFO networking_nsxv3.common.synchronization [req-524ec4ee-ec9d-4bdf-9d45-a5d256911e38 req-ca3c486e-2395-481d-99a8-7ba09e9019d8 tempest-FloatingIPsAssociationTestJSON-1856813460 tempest-FloatingIPsAssociationTestJSON-1856813460-project-member] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 726.234809] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 726.235133] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.235287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.235360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.235622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.235775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.236272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.236272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.236363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.236431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.236611] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.289126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.289126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.289126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.289126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.289126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.290252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.291040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.291427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.291867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.292245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.292512] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.363191] env[65222]: INFO networking_nsxv3.common.synchronization [req-e7282086-8622-4d7e-a457-c24afd399e33 req-b136b66e-a52b-44f4-8e45-877a7e0e861b tempest-ServerTagsTestJSON-1255512112 tempest-ServerTagsTestJSON-1255512112-project-member] Enqueued Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 726.364265] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGHEST for action security_group_members [ 726.364627] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.364841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.364926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.365232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.365393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.365500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.365627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.365825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.366095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.366227] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.703997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.703997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.703997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.703997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.703997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.704456] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e493ec04-5a13-467d-82fd-1b364368163b is going to be created. [ 726.737787] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.737787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.738474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.738474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.738474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.739701] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.755260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: UNINITIALIZED for 2s [ 726.798032] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934c2ee4-8fd3-4a49-b822-071d800eb172: rpc.has_security_group_logging(os_id): False [ 726.827768] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.827923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.828008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.828301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.828426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.828664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.828812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.828889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.829675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.829675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.829675] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.829675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.829675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.829893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.829893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.830064] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.830154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.830202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.830355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.830445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.830633] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be created. [ 726.868641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.868815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.868918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.869232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.869327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.869530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.870245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.870245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.870245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.870245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.870245] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d is going to be updated. [ 726.912964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.912964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.912964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.913507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.913507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.924897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.925215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.925215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.925849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.925849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.927794] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: IN_PROGRESS for 2s [ 726.940297] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 727.184713] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.184910] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.186020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.186020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.186020] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.186020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.186020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.186318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.186318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.186487] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.186538] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.186639] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.186743] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.186842] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.186939] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.187115] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.211197] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.211197] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.211197] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.211197] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-893" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.211557] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-fa0b37e3-dbd6-414c-8632-e765f9af0822 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.211557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.211834] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.214432] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.214432] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa0b37e3-dbd6-414c-8632-e765f9af0822',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.241779] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.716915] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.717359] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.717359] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.717542] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.717683] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.717843] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port fa0b37e3-dbd6-414c-8632-e765f9af0822 not found, creating... [ 727.718242] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.718381] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.718422] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.718849] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.719057] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.719635] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.719837] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.719946] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.720323] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.720456] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.720595] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: fa0b37e3-dbd6-414c-8632-e765f9af0822 is going to be created. [ 727.741194] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.741396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.741618] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.741790] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.742011] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.742235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.743743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.743858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.743912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.744219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.744288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.744338] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be updated. [ 727.774246] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.774410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.774459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.774676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.775674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.787938] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 728.007617] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 728.007864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.008173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.008347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.008613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.008742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.008836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.009049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.009149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.009262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.009447] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.009558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.009638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.009797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.009948] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.010099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.010187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.010364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.010486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.010594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.010693] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.513112] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaddab6-0327-438e-a968-548042cf4e7a: rpc.has_security_group_logging(os_id): False [ 728.536901] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.537140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.537204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.537537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.537794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.537997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.538162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.538268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.538425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.538507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.538722] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.538817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.538885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.539091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.539190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.539382] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.539471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.539575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.539757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.539757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.539851] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be created. [ 728.591030] env[65222]: INFO networking_nsxv3.common.synchronization [req-524ec4ee-ec9d-4bdf-9d45-a5d256911e38 req-ab486ed6-09d1-4e50-9623-450c8e1eecbf service nova] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_rules [ 728.591030] env[65222]: INFO networking_nsxv3.common.synchronization [req-524ec4ee-ec9d-4bdf-9d45-a5d256911e38 req-ab486ed6-09d1-4e50-9623-450c8e1eecbf service nova] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 728.591030] env[65222]: INFO networking_nsxv3.common.synchronization [req-524ec4ee-ec9d-4bdf-9d45-a5d256911e38 req-ab486ed6-09d1-4e50-9623-450c8e1eecbf service nova] Enqueued Resource ID: fa0b37e3-dbd6-414c-8632-e765f9af0822 with Priority: HIGHEST for action port [ 728.591268] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_rules [ 728.591428] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 728.591468] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa0b37e3-dbd6-414c-8632-e765f9af0822 with Priority: HIGHEST for action port [ 728.591845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.592009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.592009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.592212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.592309] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.593976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.594104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.594236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa0b37e3-dbd6-414c-8632-e765f9af0822 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.594369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.594405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.594769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.594769] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa0b37e3-dbd6-414c-8632-e765f9af0822',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.610164] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.610164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.610164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.610164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.610164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.629552] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 728.787839] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: SUCCESS [ 728.787839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.787839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.788343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.788343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.788444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.788511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.788680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.788760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.788850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.788936] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.949057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f008b7-879d-4427-a2d5-c69aea80237d in Status: SUCCESS [ 728.949057] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d deletion is rescheduled due to dependency. [ 728.949803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.962210] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 728.962892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.097892] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.098456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.100289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa0b37e3-dbd6-414c-8632-e765f9af0822 with status ACTIVE [ 729.100289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.100289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.100289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.100289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.100289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.100289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.100521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.100870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.101138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.101710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.101964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.102682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.102682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.102682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.102682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.103035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa0b37e3-dbd6-414c-8632-e765f9af0822 is going to be updated. [ 729.135166] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.135166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.135166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.135166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.135166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.135540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa0b37e3-dbd6-414c-8632-e765f9af0822" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.292281] env[65222]: INFO networking_nsxv3.common.synchronization [None req-51450771-39cc-4078-a8a9-1e0015c11b36 None None] Enqueued Resource ID: 90f45b2e-dfa5-4785-9b89-8b2420e71f12 with Priority: HIGHEST for action port [ 729.292972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.297585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.297585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.297585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.297585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.298122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.298122] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.298733] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90f45b2e-dfa5-4785-9b89-8b2420e71f12 with Priority: HIGHEST for action port [ 729.299873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-90f45b2e-dfa5-4785-9b89-8b2420e71f12 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.299873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90f45b2e-dfa5-4785-9b89-8b2420e71f12" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.299873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90f45b2e-dfa5-4785-9b89-8b2420e71f12" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.300812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90f45b2e-dfa5-4785-9b89-8b2420e71f12" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.300812] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90f45b2e-dfa5-4785-9b89-8b2420e71f12',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.799593] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 729.799924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.800116] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e493ec04-5a13-467d-82fd-1b364368163b: rpc.has_security_group_logging(os_id): False [ 729.801131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.801361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.801618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.801848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.801848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.802034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.802143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.802263] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.803172] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90f45b2e-dfa5-4785-9b89-8b2420e71f12 [ 729.803361] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.803493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.803562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.803715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.803796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.803898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90f45b2e-dfa5-4785-9b89-8b2420e71f12 already deleted. [ 729.804012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90f45b2e-dfa5-4785-9b89-8b2420e71f12" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.822861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.822861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.823046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.823185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.823341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.823554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.823670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.823835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.824223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.824223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.824312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.824391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.824447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.824588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.824672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.824863] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.826183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.826563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.826731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.826809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.826898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e493ec04-5a13-467d-82fd-1b364368163b is going to be created. [ 729.898885] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.899264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.899368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.899644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.899889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.913169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: IN_PROGRESS for 2s [ 730.305840] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.651068] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 730.651761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.651832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.652193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.652321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.812613] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.157606] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.157606] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.157606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.157606] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.318099] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.318099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.318099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.318099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.318099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.318099] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be updated. [ 731.366228] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.366228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.366228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.366826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.367644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.389502] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 731.660052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.660459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.660459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.660576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.660731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.660826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.660904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.661070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.661179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.661265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.661422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.661524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.661577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.661719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.661881] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.661976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.662048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.662198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.662264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.662340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.662451] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.730405] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0ba5b02d-2c36-4968-91d5-0544e99b8ac3 None None] Enqueued Resource ID: 2700c7f1-ad25-4752-8ef2-c522684c9edb with Priority: HIGHEST for action port [ 731.730959] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2700c7f1-ad25-4752-8ef2-c522684c9edb with Priority: HIGHEST for action port [ 731.731332] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2700c7f1-ad25-4752-8ef2-c522684c9edb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.731452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2700c7f1-ad25-4752-8ef2-c522684c9edb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.731493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2700c7f1-ad25-4752-8ef2-c522684c9edb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.731733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2700c7f1-ad25-4752-8ef2-c522684c9edb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.731826] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2700c7f1-ad25-4752-8ef2-c522684c9edb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.865355] env[65222]: INFO networking_nsxv3.common.synchronization [req-5883929e-22bb-40b4-93d9-e4f4fcc55a85 req-bda65109-72d8-45ef-a5da-001a5f3ea86b tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 731.866180] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 731.866826] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.866826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.866826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.866998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.866998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.867356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.867356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.867356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.867495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.867495] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.926465] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: SUCCESS [ 731.926874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.165877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaddab6-0327-438e-a968-548042cf4e7a: rpc.has_security_group_logging(os_id): False [ 732.194350] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.194505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.194937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.194937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.194937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.195133] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.195214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.195335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.195471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.195605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.195742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.195839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.196241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.196241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.196241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.196401] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.196401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.196513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.196564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.196617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.196731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 732.236043] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2700c7f1-ad25-4752-8ef2-c522684c9edb [ 732.236674] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.237057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.237231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.237523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.237697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.237864] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2700c7f1-ad25-4752-8ef2-c522684c9edb already deleted. [ 732.238031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2700c7f1-ad25-4752-8ef2-c522684c9edb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.295196] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.295350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.295424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.295642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.295792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.323945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 732.371768] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.716807] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.716903] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.717100] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.717401] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.717685] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.717860] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.717974] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.718967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.719977] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.720377] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.720543] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.720655] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.720803] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.720861] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.720960] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.721113] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.749123] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.749343] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.749835] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.749835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.751088] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-c13e4e51-1a59-4d1f-aab0-7450238a0f91 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.751088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.751088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.751673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.751778] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13e4e51-1a59-4d1f-aab0-7450238a0f91',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.875148] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.080338] env[65222]: INFO networking_nsxv3.common.synchronization [None req-bb25a971-6f61-498f-a5ce-2a902d803a8c None None] Enqueued Resource ID: 1fdf9599-6865-47d5-8eeb-6f872ce204e3 with Priority: HIGHEST for action port [ 733.081425] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdf9599-6865-47d5-8eeb-6f872ce204e3 with Priority: HIGHEST for action port [ 733.083916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fdf9599-6865-47d5-8eeb-6f872ce204e3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.084153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fdf9599-6865-47d5-8eeb-6f872ce204e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.084339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fdf9599-6865-47d5-8eeb-6f872ce204e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.084553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fdf9599-6865-47d5-8eeb-6f872ce204e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.084605] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fdf9599-6865-47d5-8eeb-6f872ce204e3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.254538] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.254811] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.254973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.255307] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.255497] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.255675] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port c13e4e51-1a59-4d1f-aab0-7450238a0f91 not found, creating... [ 733.255995] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.256203] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.256326] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.256594] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.256771] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.257202] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.257388] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.257499] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.257702] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.257825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.257956] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: c13e4e51-1a59-4d1f-aab0-7450238a0f91 is going to be created. [ 733.280354] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.280570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.280688] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.280997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.281288] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.281515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.377822] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.378034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.378094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.378372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.378480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.378595] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 733.404254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 733.404480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.406044] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.406044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.406044] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.428169] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.428489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.428590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.428806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.428955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.445651] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 733.587514] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fdf9599-6865-47d5-8eeb-6f872ce204e3 [ 733.587725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.587867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.587940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.588298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.588399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.588489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fdf9599-6865-47d5-8eeb-6f872ce204e3 already deleted. [ 733.588592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fdf9599-6865-47d5-8eeb-6f872ce204e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.909449] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.909906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.909906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.909906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.910195] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.910468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.910551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.910640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.910812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.911113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.911303] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.911383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.911441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.911572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.911763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.911763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.911859] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.003527] env[65222]: INFO networking_nsxv3.common.synchronization [req-5883929e-22bb-40b4-93d9-e4f4fcc55a85 req-69aaa233-fc85-4556-8351-ee44ac55116a service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 734.003612] env[65222]: INFO networking_nsxv3.common.synchronization [req-5883929e-22bb-40b4-93d9-e4f4fcc55a85 req-69aaa233-fc85-4556-8351-ee44ac55116a service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 734.003776] env[65222]: INFO networking_nsxv3.common.synchronization [req-5883929e-22bb-40b4-93d9-e4f4fcc55a85 req-69aaa233-fc85-4556-8351-ee44ac55116a service nova] Enqueued Resource ID: c13e4e51-1a59-4d1f-aab0-7450238a0f91 with Priority: HIGHEST for action port [ 734.004292] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 734.004432] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 734.004542] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c13e4e51-1a59-4d1f-aab0-7450238a0f91 with Priority: HIGHEST for action port [ 734.004818] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.004953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.005029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.005232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.005308] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.006197] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.007577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.007577] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c13e4e51-1a59-4d1f-aab0-7450238a0f91 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.007577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.007577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.007577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.007577] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13e4e51-1a59-4d1f-aab0-7450238a0f91',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.346968] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 734.347619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.414482] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 311b5750-44a1-4206-b22b-cccdf5cbdffe: rpc.has_security_group_logging(os_id): False [ 734.441325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.441596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.441596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.441981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.442133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.442427] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.442624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.442766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.442961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.443171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.443556] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.443556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.443717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.445758] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.445758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.445758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be updated. [ 734.509571] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.509805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.510087] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c13e4e51-1a59-4d1f-aab0-7450238a0f91 with status ACTIVE [ 734.510308] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.510437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.510503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.510725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.510848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.510992] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.511118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.511208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.511338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.511424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.511833] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.511833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.511833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.511983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.511983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.512170] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c13e4e51-1a59-4d1f-aab0-7450238a0f91 is going to be updated. [ 734.528234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.528420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.528525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.528872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.529102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.544545] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.544545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.544545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.544545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.544545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.544545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c13e4e51-1a59-4d1f-aab0-7450238a0f91" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.550060] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 735.219739] env[65222]: INFO networking_nsxv3.common.synchronization [None req-8e7058ae-ca2c-4383-bb63-09f26bb54f5d None None] Enqueued Resource ID: b924ef31-4440-4320-912f-300c0c05be6a with Priority: HIGHEST for action port [ 735.220163] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b924ef31-4440-4320-912f-300c0c05be6a with Priority: HIGHEST for action port [ 735.220878] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b924ef31-4440-4320-912f-300c0c05be6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.220878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b924ef31-4440-4320-912f-300c0c05be6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.220878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b924ef31-4440-4320-912f-300c0c05be6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.221110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b924ef31-4440-4320-912f-300c0c05be6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222067] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b924ef31-4440-4320-912f-300c0c05be6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.461696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 735.461966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.462538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.462764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.462970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.463166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.463333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.463395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.463480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.463584] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.724966] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b924ef31-4440-4320-912f-300c0c05be6a [ 735.724966] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.724966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.724966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.725950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.726197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.726576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b924ef31-4440-4320-912f-300c0c05be6a already deleted. [ 735.726576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b924ef31-4440-4320-912f-300c0c05be6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.967782] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.471403] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.567078] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 736.567078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.976142] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.980023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.980023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.980023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.980023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.980023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 737.015082] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.015082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.015082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.015082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.015529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.029403] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 738.337180] env[65222]: INFO networking_nsxv3.common.synchronization [None req-3df2c75b-79dc-40bc-81b5-2f2103b7c291 None None] Enqueued Resource ID: 482f12d3-580a-40a9-ab67-d223623bbcb0 with Priority: HIGHEST for action port [ 738.337180] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482f12d3-580a-40a9-ab67-d223623bbcb0 with Priority: HIGHEST for action port [ 738.338505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-482f12d3-580a-40a9-ab67-d223623bbcb0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.339141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-482f12d3-580a-40a9-ab67-d223623bbcb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.340254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-482f12d3-580a-40a9-ab67-d223623bbcb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.340254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-482f12d3-580a-40a9-ab67-d223623bbcb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.340452] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('482f12d3-580a-40a9-ab67-d223623bbcb0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.759677] env[65222]: INFO networking_nsxv3.common.synchronization [None req-96b64b0f-c639-4504-b3bf-cf0483996f71 None None] Enqueued Resource ID: 2f277adc-75da-4826-b26d-2307ab69deb8 with Priority: HIGHEST for action port [ 738.759677] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f277adc-75da-4826-b26d-2307ab69deb8 with Priority: HIGHEST for action port [ 738.759677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f277adc-75da-4826-b26d-2307ab69deb8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.762085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f277adc-75da-4826-b26d-2307ab69deb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.762085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f277adc-75da-4826-b26d-2307ab69deb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.762085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f277adc-75da-4826-b26d-2307ab69deb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.762085] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f277adc-75da-4826-b26d-2307ab69deb8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.843639] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 482f12d3-580a-40a9-ab67-d223623bbcb0 [ 738.843639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.843839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.843839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.844053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.844147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.844246] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:482f12d3-580a-40a9-ab67-d223623bbcb0 already deleted. [ 738.844326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-482f12d3-580a-40a9-ab67-d223623bbcb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.042135] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 739.042135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.042298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.042382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.042576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.042991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.042991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.042991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.042991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.043171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.043171] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.264417] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f277adc-75da-4826-b26d-2307ab69deb8 [ 739.264673] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.264942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.264942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.265485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.265485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.265485] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f277adc-75da-4826-b26d-2307ab69deb8 already deleted. [ 739.265485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f277adc-75da-4826-b26d-2307ab69deb8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.547226] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.547629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.547629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.547754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.547898] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.547948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.547981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.548164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.548248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.548336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.549222] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.549388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.549660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.549660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.549750] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.549840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.549840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.550008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.550073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.550165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.550279] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.054600] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934c2ee4-8fd3-4a49-b822-071d800eb172: rpc.has_security_group_logging(os_id): False [ 740.075894] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.075894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.075894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.075894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.075894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.076159] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.076159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.076230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.076383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.077822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.077822] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.077822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.077822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.077822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.078540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.078677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.078853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.078950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.079199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.079287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.079374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 740.144735] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.144735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.144735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.145979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.145979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.162030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 740.408978] env[65222]: INFO networking_nsxv3.common.synchronization [None req-80b1d239-8bbf-49a8-ab6f-31db348ac9d0 None None] Enqueued Resource ID: f7881f49-9a91-422f-a112-189b567e4022 with Priority: HIGHEST for action port [ 740.409644] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7881f49-9a91-422f-a112-189b567e4022 with Priority: HIGHEST for action port [ 740.409952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7881f49-9a91-422f-a112-189b567e4022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.410389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7881f49-9a91-422f-a112-189b567e4022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.410511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7881f49-9a91-422f-a112-189b567e4022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.411027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7881f49-9a91-422f-a112-189b567e4022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.411119] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7881f49-9a91-422f-a112-189b567e4022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.685647] env[65222]: INFO networking_nsxv3.common.synchronization [req-d39d4314-861c-405f-818c-c8fd3293c79a req-701d127f-0649-4031-bdc6-888b2f151a14 tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 740.686730] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 740.687037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.687114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.687164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.687416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.687593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.687961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.688310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.688310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.689203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.692461] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.835607] env[65222]: INFO networking_nsxv3.common.synchronization [req-92d1985d-390e-4d3c-98d3-2709d6e29505 req-1ea3d35e-8186-4e2f-a275-53cd79aafb0a tempest-ServersNegativeTestJSON-2124253759 tempest-ServersNegativeTestJSON-2124253759-project-member] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 740.836015] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 740.836375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.837699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.837699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.837984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.838116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.838232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.838296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.838457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.838546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.838647] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.913942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7881f49-9a91-422f-a112-189b567e4022 [ 740.914757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.914952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.915055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.915273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.916468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.916468] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7881f49-9a91-422f-a112-189b567e4022 already deleted. [ 740.916468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7881f49-9a91-422f-a112-189b567e4022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.976259] env[65222]: INFO networking_nsxv3.common.synchronization [None req-22e1ae88-4d98-44bf-9bf2-69b02a528fb0 None None] Enqueued Resource ID: cf9fc103-9148-44d6-bf34-34970f009533 with Priority: HIGHEST for action port [ 740.979946] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf9fc103-9148-44d6-bf34-34970f009533 with Priority: HIGHEST for action port [ 740.980547] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf9fc103-9148-44d6-bf34-34970f009533 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.980681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf9fc103-9148-44d6-bf34-34970f009533" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.981587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf9fc103-9148-44d6-bf34-34970f009533" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.981587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf9fc103-9148-44d6-bf34-34970f009533" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.981587] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf9fc103-9148-44d6-bf34-34970f009533',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.192316] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.344307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.344677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.344898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.345299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.345742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.346225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.346374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.346547] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be already deleted. [ 741.346685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.484198] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf9fc103-9148-44d6-bf34-34970f009533 [ 741.485461] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.485461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.485461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.485461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.485461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.485461] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf9fc103-9148-44d6-bf34-34970f009533 already deleted. [ 741.485461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf9fc103-9148-44d6-bf34-34970f009533" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.693074] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.693409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.693409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.694216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.694330] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.694522] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.694641] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.694857] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.694989] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.695233] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.695353] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.695546] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.695657] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.695763] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.695924] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.697163] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.697719] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.716401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.719104] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.719104] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.719104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.719104] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-48408075-62ca-4c7a-a830-7c8cfc8e92fb taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.719104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.719104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.719104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.719104] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48408075-62ca-4c7a-a830-7c8cfc8e92fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.177998] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 742.178426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.200163] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.200374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.200374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.200618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.200692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.200783] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 742.221992] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.222274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.222393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.222679] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.222892] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.223020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 48408075-62ca-4c7a-a830-7c8cfc8e92fb not found, creating... [ 742.223506] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.223726] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.223840] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.224078] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.224231] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.224573] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.224755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.224866] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.225106] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.225256] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.225398] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb is going to be created. [ 742.241706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.241915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.241985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.242224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.242374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.251031] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.251250] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.251369] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.251657] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.251901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.252152] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.267958] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 742.950443] env[65222]: INFO networking_nsxv3.common.synchronization [req-92d1985d-390e-4d3c-98d3-2709d6e29505 req-5c7870e6-8b54-45fb-b1b3-09fead87e11d service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 742.950708] env[65222]: INFO networking_nsxv3.common.synchronization [req-92d1985d-390e-4d3c-98d3-2709d6e29505 req-5c7870e6-8b54-45fb-b1b3-09fead87e11d service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 742.950796] env[65222]: INFO networking_nsxv3.common.synchronization [req-92d1985d-390e-4d3c-98d3-2709d6e29505 req-5c7870e6-8b54-45fb-b1b3-09fead87e11d service nova] Enqueued Resource ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb with Priority: HIGHEST for action port [ 742.951321] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 742.951464] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 742.952883] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb with Priority: HIGHEST for action port [ 742.953312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.953312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.953456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.953633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.953716] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.955012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.955012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.955012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.955159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.955192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.955294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.955345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.955478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.955562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.955647] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.956351] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-48408075-62ca-4c7a-a830-7c8cfc8e92fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.956459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.956519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.957630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.957630] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48408075-62ca-4c7a-a830-7c8cfc8e92fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.049603] env[65222]: INFO networking_nsxv3.common.synchronization [None req-cad44b32-5255-4a63-b883-86b470f15753 None None] Enqueued Resource ID: 4a741abe-e1f3-4627-8d54-5a35260c9a36 with Priority: HIGHEST for action port [ 743.049792] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a741abe-e1f3-4627-8d54-5a35260c9a36 with Priority: HIGHEST for action port [ 743.050017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a741abe-e1f3-4627-8d54-5a35260c9a36 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.050512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a741abe-e1f3-4627-8d54-5a35260c9a36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.050584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a741abe-e1f3-4627-8d54-5a35260c9a36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.051063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a741abe-e1f3-4627-8d54-5a35260c9a36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.051151] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a741abe-e1f3-4627-8d54-5a35260c9a36',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.459949] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.461270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.461393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.461724] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48408075-62ca-4c7a-a830-7c8cfc8e92fb with status ACTIVE [ 743.461920] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.462054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.462129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.462407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.462503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.462688] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.462787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.462870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.463742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.466267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.466267] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.466267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.466267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.466267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.466267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.466267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb is going to be updated. [ 743.490531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.490730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.490730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.490934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.491085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.491243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.553152] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a741abe-e1f3-4627-8d54-5a35260c9a36 [ 743.553390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.553524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.553594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.553811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.553904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.554008] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a741abe-e1f3-4627-8d54-5a35260c9a36 already deleted. [ 743.554098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a741abe-e1f3-4627-8d54-5a35260c9a36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.967181] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.278984] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 744.279274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.315377] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d04efe4c-71f3-4939-857d-fea5b555699b None None] Enqueued Resource ID: 40dd4a3d-e1ce-4de4-84cb-1f2635022a4f with Priority: HIGHEST for action port [ 744.315916] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4a3d-e1ce-4de4-84cb-1f2635022a4f with Priority: HIGHEST for action port [ 744.316919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-40dd4a3d-e1ce-4de4-84cb-1f2635022a4f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.317128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40dd4a3d-e1ce-4de4-84cb-1f2635022a4f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.317429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40dd4a3d-e1ce-4de4-84cb-1f2635022a4f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.317491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40dd4a3d-e1ce-4de4-84cb-1f2635022a4f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.317584] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40dd4a3d-e1ce-4de4-84cb-1f2635022a4f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.472968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.473143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.473204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.473413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.473506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.473601] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be created. [ 744.504879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.505545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.505545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.505545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.505545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.516105] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: UNINITIALIZED for 2s [ 744.820153] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40dd4a3d-e1ce-4de4-84cb-1f2635022a4f [ 744.820305] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.820457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.820521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.822223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.822574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.822574] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40dd4a3d-e1ce-4de4-84cb-1f2635022a4f already deleted. [ 744.822574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40dd4a3d-e1ce-4de4-84cb-1f2635022a4f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.172187] env[65222]: INFO networking_nsxv3.common.synchronization [None req-fec87b32-2182-4910-b889-93c6b93fc092 None None] Enqueued Resource ID: 1e2e3ddc-9482-43d7-a560-ec5fd6bff028 with Priority: HIGHEST for action port [ 746.172959] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2e3ddc-9482-43d7-a560-ec5fd6bff028 with Priority: HIGHEST for action port [ 746.172959] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e2e3ddc-9482-43d7-a560-ec5fd6bff028 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.173106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e2e3ddc-9482-43d7-a560-ec5fd6bff028" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.173554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e2e3ddc-9482-43d7-a560-ec5fd6bff028" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.173554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e2e3ddc-9482-43d7-a560-ec5fd6bff028" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.173554] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e2e3ddc-9482-43d7-a560-ec5fd6bff028',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.533033] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.533033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.533033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.533033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.548018] env[65222]: INFO networking_nsxv3.common.synchronization [None req-3cb7f16b-4c73-4146-98ee-f4647faed772 None None] Enqueued Resource ID: f03f1741-59f4-40ce-a46c-05bffe96635b with Priority: HIGHEST for action port [ 746.548018] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f03f1741-59f4-40ce-a46c-05bffe96635b with Priority: HIGHEST for action port [ 746.548629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-f03f1741-59f4-40ce-a46c-05bffe96635b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.548951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f03f1741-59f4-40ce-a46c-05bffe96635b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.549447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f03f1741-59f4-40ce-a46c-05bffe96635b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.549904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f03f1741-59f4-40ce-a46c-05bffe96635b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.550139] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f03f1741-59f4-40ce-a46c-05bffe96635b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.678685] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e2e3ddc-9482-43d7-a560-ec5fd6bff028 [ 746.678933] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.679089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.679160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.679483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.679587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.679684] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e2e3ddc-9482-43d7-a560-ec5fd6bff028 already deleted. [ 746.679770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e2e3ddc-9482-43d7-a560-ec5fd6bff028" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.036687] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.036896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.036989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.037301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.037510] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.037639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.037721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.037921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.038061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.038196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.038431] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.038550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.039136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.039368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.039575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.039730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.039831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.040072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.040278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.040345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.040457] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.053214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f03f1741-59f4-40ce-a46c-05bffe96635b [ 747.054049] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.054049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.054049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.054049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.054467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.054655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f03f1741-59f4-40ce-a46c-05bffe96635b already deleted. [ 747.054763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f03f1741-59f4-40ce-a46c-05bffe96635b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.148436] env[65222]: INFO networking_nsxv3.common.synchronization [req-1585dba1-b979-4b92-85e2-86befb51c218 req-ca1c8fc4-11bb-4c0d-96cb-4792ae3581f9 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 747.148436] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 747.148436] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.148436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.148436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.148436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.148777] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.148777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.148777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.148777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.148910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.148940] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.543089] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef0e22a7-af6f-4355-8779-ca32518594be: rpc.has_security_group_logging(os_id): False [ 747.564161] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.564313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.564386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.564599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.564691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.564979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.565120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.565120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.565440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.565440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.565546] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.565606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.565662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.565799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.565882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.566514] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.566822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.566913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.567080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.567166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.567278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be created. [ 747.642739] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.642739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.642739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.642739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.642739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.651627] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.651775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.652459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.652459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.652459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.652459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.652691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.652691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.652754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.652803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.652886] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 747.660911] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 747.686898] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.687044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.687108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.687416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.687801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.702030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 747.937996] env[65222]: INFO networking_nsxv3.common.synchronization [req-473156f6-a4e1-4e67-9325-60e0f2420434 req-b756aff1-bfa8-49f1-987e-ab4e4c1981be tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 747.938898] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 747.939528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.939730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.939833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.940079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.940257] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.940336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.940427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.940558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.940657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.940753] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.443193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.443651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.443737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.443961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.444070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.444285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.444442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.444569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.444748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.444876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.445075] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 748.477123] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.477284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.477355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.477617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.477708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489961] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 749.674968] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 749.675266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.711797] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 749.711976] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 749.712103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.501823] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 750.502027] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a deletion is rescheduled due to dependency. [ 750.502140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.474950] env[65222]: INFO networking_nsxv3.common.synchronization [req-5f34764a-53d0-4119-9a4a-5eb8a3a1468a req-a9919133-6a67-4ed7-8f4e-ac66d527951b tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 751.475159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 751.475422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.475548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.475610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.475869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.476091] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.476208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.476273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.476427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.476515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.476605] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.810027] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.810216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.810328] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.810588] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.810835] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.810983] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.811403] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.811987] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.812087] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.812403] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.812517] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.812626] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.812729] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.812827] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.812934] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.813093] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.832117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.832345] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.832409] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.832582] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.832903] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b882d906-1c93-474c-82e2-0e099233822c taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.833357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.833357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.833509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.833644] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b882d906-1c93-474c-82e2-0e099233822c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.978833] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.978988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.979076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.979352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.979458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.979704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.979811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.979874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.980291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.980291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.980291] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 already deleted. [ 751.980291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.336201] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.336496] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.336652] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.336993] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.337183] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.337392] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b882d906-1c93-474c-82e2-0e099233822c not found, creating... [ 752.337659] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.337808] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.337919] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.338154] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.338284] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.339149] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.339516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.339516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.339672] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.339824] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.339971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b882d906-1c93-474c-82e2-0e099233822c is going to be created. [ 752.361156] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.361391] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.361496] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.361875] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.362124] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.362372] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [req-5f34764a-53d0-4119-9a4a-5eb8a3a1468a req-2209d575-8a8f-412c-8e06-f7db5b02c40a service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [req-5f34764a-53d0-4119-9a4a-5eb8a3a1468a req-2209d575-8a8f-412c-8e06-f7db5b02c40a service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [req-5f34764a-53d0-4119-9a4a-5eb8a3a1468a req-2209d575-8a8f-412c-8e06-f7db5b02c40a service nova] Enqueued Resource ID: b882d906-1c93-474c-82e2-0e099233822c with Priority: HIGHEST for action port [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 753.072554] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b882d906-1c93-474c-82e2-0e099233822c with Priority: HIGHEST for action port [ 753.073775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.074068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.074345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.075129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.075129] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.076573] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.076884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.076884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.077179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.077436] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.077574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.077709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.077940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.077940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.078090] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.078891] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b882d906-1c93-474c-82e2-0e099233822c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.079039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.079137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.079377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.079531] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b882d906-1c93-474c-82e2-0e099233822c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.581856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.582079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.583028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.583810] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b882d906-1c93-474c-82e2-0e099233822c with status ACTIVE [ 753.584066] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.584228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.584819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.584819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.584819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.585223] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.585223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.585223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.585849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.585849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.585849] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.586014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.586014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.586787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.586787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.586787] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b882d906-1c93-474c-82e2-0e099233822c is going to be updated. [ 753.611189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.611360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.611402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.611611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.611743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.611985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b882d906-1c93-474c-82e2-0e099233822c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.092566] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.595608] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.595876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.595956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.596217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.596318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.596440] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be created. [ 754.622313] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.622453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.622529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.622745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.622919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.633508] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: UNINITIALIZED for 2s [ 754.668376] env[65222]: INFO networking_nsxv3.common.synchronization [req-2ced8f26-7265-48ca-b19e-72fd8aa71c79 req-914049e8-cf3a-43ab-8ace-07d72961bea1 tempest-ListImageFiltersTestJSON-1062059555 tempest-ListImageFiltersTestJSON-1062059555-project-member] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 754.668930] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 754.669295] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.669603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.669603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.669777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.669824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.673432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.673432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.673432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.673656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.673656] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.962265] env[65222]: INFO networking_nsxv3.common.synchronization [req-cbff8116-c4b4-4e12-8ba7-5bfa6a721f79 req-e832013d-fa05-4b9b-9152-2747a152efaf tempest-InstanceActionsNegativeTestJSON-1307603883 tempest-InstanceActionsNegativeTestJSON-1307603883-project-member] Enqueued Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 754.962265] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGHEST for action security_group_members [ 754.962265] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.962265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.962706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.964780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.964780] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.964780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.964780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.964780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.964780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.964780] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.178423] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.465764] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.465942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.466038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.466289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.466406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.466637] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.466792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.466855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.467098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.467227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.467347] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e493ec04-5a13-467d-82fd-1b364368163b is going to be updated. [ 755.497552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.497714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.497786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.498015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.498163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.507557] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: IN_PROGRESS for 2s [ 755.683219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.185515] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.185815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.185815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.185974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.186068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.186167] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be updated. [ 756.214144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.214302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.214365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.214570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.214716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.224012] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 756.646553] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 756.646773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.646949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.647196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.647424] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.647556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.647627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.647862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.647906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.648140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.648266] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.151122] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.151122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.151360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.151446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.151636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.151742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.151809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.151966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.152071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.152164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.152338] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.152437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.152520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.152670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.152808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.152937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.153015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.153184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.153276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.153381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.153478] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.518515] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e493ec04-5a13-467d-82fd-1b364368163b in Status: SUCCESS [ 757.518798] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e493ec04-5a13-467d-82fd-1b364368163b deletion is rescheduled due to dependency. [ 757.518842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.655603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8b0390-6b22-4e1a-92fa-1046e5b93e83: rpc.has_security_group_logging(os_id): False [ 757.674102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.674265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.674307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.674521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.674613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.674820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.674929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.674988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.675157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.675231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.675440] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.675529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.675590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.675729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.675802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.675973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.676077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.676138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.676274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.676349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.676447] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be created. [ 757.731750] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.731903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.731967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.732209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.732381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.743981] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 758.238685] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 758.239146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.837507] env[65222]: INFO networking_nsxv3.common.synchronization [req-4b487954-7509-4571-885e-d9acecded138 req-bc9bb853-3d8a-40f4-bee4-fc0f149b1aa6 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 758.838117] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 758.838450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.838577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.838644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.838992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.839198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.839324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.839448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.839562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.839650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.839762] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.342418] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.342578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.342886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.342886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.342982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.343188] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.343358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.343358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.343499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.343573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.343670] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c already deleted. [ 759.343754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.421515] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.421515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.421515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.422245] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.422245] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.422639] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.422639] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.422639] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.422844] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.422971] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.423107] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.423263] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.423501] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.423501] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.423617] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.423682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.442506] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.442506] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.442764] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.443203] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.443203] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-bfb195ab-a257-4ef8-8a05-c177e5196e28 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.443772] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.443772] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.443772] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.443921] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb195ab-a257-4ef8-8a05-c177e5196e28',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.759382] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 759.760572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.793929] env[65222]: INFO networking_nsxv3.common.synchronization [req-f28a4a1a-b063-4971-aeed-d2b981bde256 req-d8e8d80c-acda-41fe-807b-02175d1f7d44 tempest-ImagesOneServerTestJSON-578215935 tempest-ImagesOneServerTestJSON-578215935-project-member] Enqueued Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 759.794483] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 with Priority: HIGHEST for action security_group_members [ 759.794786] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.794915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.794980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.795196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.795349] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.795450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.795510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.795659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.795744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.795837] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.946976] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.946976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.946976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.946976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.948249] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.948249] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port bfb195ab-a257-4ef8-8a05-c177e5196e28 not found, creating... [ 759.948249] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.948249] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.948249] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.948429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.948548] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.948793] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.948941] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.949058] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.949252] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.949448] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.949564] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: bfb195ab-a257-4ef8-8a05-c177e5196e28 is going to be created. [ 759.973101] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.973310] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.973425] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.973697] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.973923] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.974159] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.298772] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.298976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.299066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.299288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.299606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.299685] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.299738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.299796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.299931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.300017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.300109] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 is going to be updated. [ 760.350203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.350203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.350203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.350203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.350615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.362545] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: IN_PROGRESS for 2s [ 760.732096] env[65222]: INFO networking_nsxv3.common.synchronization [req-4b487954-7509-4571-885e-d9acecded138 req-48e3150b-01f4-4c08-aeae-665f40fe6f3c service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 760.732329] env[65222]: INFO networking_nsxv3.common.synchronization [req-4b487954-7509-4571-885e-d9acecded138 req-48e3150b-01f4-4c08-aeae-665f40fe6f3c service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 760.732471] env[65222]: INFO networking_nsxv3.common.synchronization [req-4b487954-7509-4571-885e-d9acecded138 req-48e3150b-01f4-4c08-aeae-665f40fe6f3c service nova] Enqueued Resource ID: bfb195ab-a257-4ef8-8a05-c177e5196e28 with Priority: HIGHEST for action port [ 760.733070] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 760.733121] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 760.733205] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb195ab-a257-4ef8-8a05-c177e5196e28 with Priority: HIGHEST for action port [ 760.733466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.733578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.733650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.734033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.734119] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.736388] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.736512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.736586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.736752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.736973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.737059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.737094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.737302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.737389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.737796] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.738859] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfb195ab-a257-4ef8-8a05-c177e5196e28 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.738970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.739426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.739426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.739540] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb195ab-a257-4ef8-8a05-c177e5196e28',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.936656] env[65222]: INFO networking_nsxv3.common.synchronization [req-71a23bfd-588e-46f8-9b4f-bec94d5de26e req-31beb5c5-e2ff-4b18-b071-0c10bc343822 tempest-FloatingIPsAssociationTestJSON-1856813460 tempest-FloatingIPsAssociationTestJSON-1856813460-project-member] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 760.937537] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 760.937836] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.938137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.938137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.938273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.938387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.938491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.938554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.938698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.938785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.938879] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.241835] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.242920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.242920] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.244022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfb195ab-a257-4ef8-8a05-c177e5196e28 with status ACTIVE [ 761.246086] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.246086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.246086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.246086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.246086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.246659] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.249728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.249728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.249728] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfb195ab-a257-4ef8-8a05-c177e5196e28 is going to be updated. [ 761.278301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.278301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.278301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.278301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.278301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.278301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfb195ab-a257-4ef8-8a05-c177e5196e28" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.440997] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.750839] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.946037] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.210077] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2fc800f6-8400-432d-87b5-fa3ef749aa5d None None] Enqueued Resource ID: 497461b3-3874-47e1-aa91-3120023b4408 with Priority: HIGHEST for action port [ 762.210077] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 497461b3-3874-47e1-aa91-3120023b4408 with Priority: HIGHEST for action port [ 762.210077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-497461b3-3874-47e1-aa91-3120023b4408 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.210077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-497461b3-3874-47e1-aa91-3120023b4408" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.210077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-497461b3-3874-47e1-aa91-3120023b4408" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.210077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-497461b3-3874-47e1-aa91-3120023b4408" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.210077] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('497461b3-3874-47e1-aa91-3120023b4408',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.253674] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.256988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.256988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.256988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.256988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.256988] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be created. [ 762.302549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.302549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.302549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.302549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.302549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.316039] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: UNINITIALIZED for 2s [ 762.372660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 in Status: SUCCESS [ 762.373165] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3 deletion is rescheduled due to dependency. [ 762.373480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.451754] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.451754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.451754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.451754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.451754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.451754] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be updated. [ 762.499009] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.499139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.499587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.499587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.499709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.510237] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 762.713310] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 497461b3-3874-47e1-aa91-3120023b4408 [ 762.713550] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.713695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.713765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.713977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.714106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.714206] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:497461b3-3874-47e1-aa91-3120023b4408 already deleted. [ 762.714278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-497461b3-3874-47e1-aa91-3120023b4408" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.715155] env[65222]: INFO networking_nsxv3.common.synchronization [req-7b459ce9-1643-414e-a76d-8fbeebc2d957 req-f43c27e9-3b0d-4135-9e4c-4d8e91445763 tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 763.715710] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 763.716011] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.716201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.716233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.716417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.716697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.716697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.716849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.716849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.716935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.717817] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.811499] env[65222]: INFO networking_nsxv3.common.synchronization [None req-1b640e97-0eac-43ea-9d03-c9de938f6f55 tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 763.812334] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 763.812936] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.812936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.812936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.813398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.813441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.925626] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ba80b998-0aa5-43b4-948e-2b45cc089042 tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 763.926618] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 763.926618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.926785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.120526] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.120526] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.120717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.121543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.121543] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.121543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.121543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.121866] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.121866] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.122867] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.122867] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.122867] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.122867] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.122867] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.122867] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.122867] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.143382] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.144050] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.147574] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.147574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.147574] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.147574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.147574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.147574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.147574] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.222960] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.327248] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.327248] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.327248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.327248] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.333926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.334221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.334441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.335168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.335168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.335168] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 already deleted. [ 764.335168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.335335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.335591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.335778] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.522735] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 764.522735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.651052] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.653818] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc not found, creating... [ 764.653818] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.653818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.654271] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.654271] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.654271] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.655255] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.655547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.655825] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc is going to be created. [ 764.677488] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.678064] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.678211] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679681] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679681] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679681] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.726823] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.834776] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.834776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.834776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.835073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.836726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.836726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.836726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.837152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.837152] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.837152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.837241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.837389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.837468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.837572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.841292] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.862843] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.864859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.864859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.864859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.865148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.865922] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 already deleted. [ 764.866567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.951363] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d1ba49bc-9605-4d94-a7a8-0b7e6bccef4f None None] Enqueued Resource ID: edb83ef6-af26-4487-96a7-70bc43c7d5e3 with Priority: HIGHEST for action port [ 764.951881] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb83ef6-af26-4487-96a7-70bc43c7d5e3 with Priority: HIGHEST for action port [ 764.952197] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-edb83ef6-af26-4487-96a7-70bc43c7d5e3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.952318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edb83ef6-af26-4487-96a7-70bc43c7d5e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.952406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edb83ef6-af26-4487-96a7-70bc43c7d5e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.952663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edb83ef6-af26-4487-96a7-70bc43c7d5e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.952747] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edb83ef6-af26-4487-96a7-70bc43c7d5e3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.228686] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.228877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.228940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.229174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.229268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.229403] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be updated. [ 765.260839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.261030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.261079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.261271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.261416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.275328] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 765.345099] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 765.364904] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.364904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.365582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.365820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.366271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.366487] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.366487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.366487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.366781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.366781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.366917] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.367098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.367098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.370138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.370138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.370138] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be created. [ 765.380669] env[65222]: INFO networking_nsxv3.common.synchronization [req-7b459ce9-1643-414e-a76d-8fbeebc2d957 req-464e182a-c8e1-4d47-b4e8-17314e3bd07f service nova] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_rules [ 765.380871] env[65222]: INFO networking_nsxv3.common.synchronization [req-7b459ce9-1643-414e-a76d-8fbeebc2d957 req-464e182a-c8e1-4d47-b4e8-17314e3bd07f service nova] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 765.381039] env[65222]: INFO networking_nsxv3.common.synchronization [req-7b459ce9-1643-414e-a76d-8fbeebc2d957 req-464e182a-c8e1-4d47-b4e8-17314e3bd07f service nova] Enqueued Resource ID: 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc with Priority: HIGHEST for action port [ 765.381561] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_rules [ 765.381697] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 765.381795] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc with Priority: HIGHEST for action port [ 765.383485] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.383648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.383736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.384734] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.384852] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.388212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.388212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.388342] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.388666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.388666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.388666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.388843] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.427796] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.427912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.427970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.428237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.428419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.440477] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 765.457040] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edb83ef6-af26-4487-96a7-70bc43c7d5e3 [ 765.457040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.457040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.457040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.457040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.457040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.457040] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edb83ef6-af26-4487-96a7-70bc43c7d5e3 already deleted. [ 765.457040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edb83ef6-af26-4487-96a7-70bc43c7d5e3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.893534] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.893534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.894779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc with status ACTIVE [ 765.894974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.895110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.895182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.895390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.895493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.895657] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.895755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.895815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.895967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.896052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.896309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.896309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.896396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.896504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.896580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.896662] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc is going to be updated. [ 765.984564] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.985180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.985260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.985474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.985611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.985776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6173147c-5a79-4d5c-b6e0-5e6ea94c5bdc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.307212] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d637d40-14af-4e46-a8f4-fe9b74fac998 req-a2c0b2a6-9ee1-4984-a133-158f94a822d1 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 766.307777] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 766.308107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.308221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.308306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.308505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.308658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.308773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.308831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.308966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.309149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.309256] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.784135] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.784135] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.784135] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.784524] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.784579] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.784732] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.784841] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.785068] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.785318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.785533] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.785643] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.785745] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.785846] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.785951] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.786061] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.786192] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.806405] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.806573] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.806704] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.806872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.807206] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-80d45531-82d2-4443-82e4-357df93410cc taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.807496] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.807720] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.808348] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.808508] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80d45531-82d2-4443-82e4-357df93410cc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.813485] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.813663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.813738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.813932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.814037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.814236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.814373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.814425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.814586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.814664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.814752] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 766.841396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.841666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.841666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.841771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.851731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 767.291761] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.291761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.291761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.292754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.293054] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.314063] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.314063] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 80d45531-82d2-4443-82e4-357df93410cc not found, creating... [ 767.314063] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.314063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.314750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.314750] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.316160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.316288] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.316521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.316656] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.316798] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 80d45531-82d2-4443-82e4-357df93410cc is going to be created. [ 767.351661] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.352040] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.352040] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.352424] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.352424] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.352558] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.455203] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 767.455438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.795913] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.044999] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d637d40-14af-4e46-a8f4-fe9b74fac998 req-38966448-3340-4cc9-8d42-e7168fdff9e4 service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 768.045258] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d637d40-14af-4e46-a8f4-fe9b74fac998 req-38966448-3340-4cc9-8d42-e7168fdff9e4 service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 768.045467] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d637d40-14af-4e46-a8f4-fe9b74fac998 req-38966448-3340-4cc9-8d42-e7168fdff9e4 service nova] Enqueued Resource ID: 80d45531-82d2-4443-82e4-357df93410cc with Priority: HIGHEST for action port [ 768.045968] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 768.046148] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 768.046249] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80d45531-82d2-4443-82e4-357df93410cc with Priority: HIGHEST for action port [ 768.046513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.046635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.046702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.046937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.046980] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.048043] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.048147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.048355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-80d45531-82d2-4443-82e4-357df93410cc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.048460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.048538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.048718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.048791] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80d45531-82d2-4443-82e4-357df93410cc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.298922] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.550568] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.551116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.551700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80d45531-82d2-4443-82e4-357df93410cc with status ACTIVE [ 768.551845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.552060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.552395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.552685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.552835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.553150] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.553434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.553727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.554060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.554197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.554534] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.554729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.555638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.555879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.556028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.556269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80d45531-82d2-4443-82e4-357df93410cc is going to be updated. [ 768.579736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.579982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.580057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.580341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.580617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.580827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80d45531-82d2-4443-82e4-357df93410cc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.802648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.802802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.802879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.803127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.803220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.803316] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be updated. [ 768.841198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.841198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.841198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.841198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.841198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.851619] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 768.862235] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 768.864670] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 deletion is rescheduled due to dependency. [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.864670] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.864670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.864670] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.368805] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.874759] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.932955] env[65222]: INFO networking_nsxv3.common.synchronization [None req-1586f276-a853-442d-bd94-a8dfed33c928 None None] Enqueued Resource ID: a6dc4f7e-6344-4204-8619-2ff09e80d468 with Priority: HIGHEST for action port [ 769.933881] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dc4f7e-6344-4204-8619-2ff09e80d468 with Priority: HIGHEST for action port [ 769.933881] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6dc4f7e-6344-4204-8619-2ff09e80d468 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.933881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6dc4f7e-6344-4204-8619-2ff09e80d468" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.933881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6dc4f7e-6344-4204-8619-2ff09e80d468" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.934383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6dc4f7e-6344-4204-8619-2ff09e80d468" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.934383] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6dc4f7e-6344-4204-8619-2ff09e80d468',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.377688] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.377975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.377975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.378142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.378232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.378336] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 770.410377] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.410675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.410786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.411010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.411162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.421540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 770.436298] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6dc4f7e-6344-4204-8619-2ff09e80d468 [ 770.436298] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.436590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.436590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.437063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.437063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.437063] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6dc4f7e-6344-4204-8619-2ff09e80d468 already deleted. [ 770.437063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6dc4f7e-6344-4204-8619-2ff09e80d468" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.863120] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 770.863791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.863791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.863915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.864140] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.864316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.865122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.865122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.865122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.865122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.865742] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.370706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.370706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.370706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.370706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.370706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.371473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.371473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.372360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.372685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.372938] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.877585] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4c36af1-3224-4449-b91e-20d98bbff745: rpc.has_security_group_logging(os_id): False [ 771.903357] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.903606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.903725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.903984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.904141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.904541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.904785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.904870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.905131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.905236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.905529] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.905651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.905727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.905906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.906041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.906358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.906515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.906627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.906836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.906941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.907467] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be updated. [ 771.983778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.983778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.983778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.983778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.984236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.997864] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 772.436758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.436758] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.436758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.436758] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.714335] env[65222]: INFO networking_nsxv3.common.synchronization [req-05596a11-b72d-4a65-849f-d327d4b85b1c req-dc62de04-3894-42e2-a946-a4c5115b6651 tempest-ImagesNegativeTestJSON-2077925014 tempest-ImagesNegativeTestJSON-2077925014-project-member] Enqueued Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 772.715492] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 772.715913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.716125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.716227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.716551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.716725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.716860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.716949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.717160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.717293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.718067] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.939855] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.940275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.940275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.940357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.940533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.940640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.940713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.940861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.940938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.941047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.941200] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.941294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.941354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.941497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.941633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.941725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.941782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.941917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.941993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.942112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.942238] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.020526] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:0 completed [ 773.020526] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:1 started [ 773.034334] env[65222]: INFO networking_nsxv3.common.synchronization [None req-069b7af7-ebe5-40ba-afaf-e1f4564d3a75 None None] Enqueued Resource ID: 5bbb5681-ba9e-47f0-a86c-df5eb0f3372a with Priority: HIGHEST for action port [ 773.035254] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bbb5681-ba9e-47f0-a86c-df5eb0f3372a with Priority: HIGHEST for action port [ 773.035874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bbb5681-ba9e-47f0-a86c-df5eb0f3372a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.035874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bbb5681-ba9e-47f0-a86c-df5eb0f3372a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.036131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bbb5681-ba9e-47f0-a86c-df5eb0f3372a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.036346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bbb5681-ba9e-47f0-a86c-df5eb0f3372a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.036506] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bbb5681-ba9e-47f0-a86c-df5eb0f3372a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.114982] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.115325] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-699" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.116293] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-699" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.116908] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-699" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.117272] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.117494] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.117677] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.118041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.118776] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.119152] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.119260] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.119404] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.119568] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.119692] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.119846] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.120232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.156069] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.156265] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.156838] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.156838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-699" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.157032] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-a704841a-7fd3-421b-8fb8-9079401fe3fd taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.157151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.157228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.158717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.158717] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a704841a-7fd3-421b-8fb8-9079401fe3fd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.220506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.220757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.220835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.221157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.221258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.221498] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.221622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.221687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.221881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.221977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.222119] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 already deleted. [ 773.222206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.446163] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a1f130e-cc8b-4415-87be-b7a8cbdda189: rpc.has_security_group_logging(os_id): False [ 773.471171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.471171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.471171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.471367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.471367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.471677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.471677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.471800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.472207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.472207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.472304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.472423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.472423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.472562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.472635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.472991] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.473492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.473492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.473492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.473492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.473700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 773.539700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bbb5681-ba9e-47f0-a86c-df5eb0f3372a [ 773.540020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.540385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.540385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.541102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.541102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.541102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bbb5681-ba9e-47f0-a86c-df5eb0f3372a already deleted. [ 773.541288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bbb5681-ba9e-47f0-a86c-df5eb0f3372a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.553574] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.553574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.553574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.553853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.554052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.572976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 773.662577] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.665022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port a704841a-7fd3-421b-8fb8-9079401fe3fd not found, creating... [ 773.665022] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.665022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.665694] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.665998] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.666486] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.666825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.667142] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.667568] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.667878] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.668174] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: a704841a-7fd3-421b-8fb8-9079401fe3fd is going to be created. [ 773.700472] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.700472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.700472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.700472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.700472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.700472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.818928] env[65222]: INFO networking_nsxv3.common.synchronization [req-19e989eb-0671-495f-9a6a-e2decfd39f4f req-3d40b979-c72d-4f21-84e4-8ce9b7eb6455 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 773.819702] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 773.820144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.820276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.820355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.820587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.820811] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.820936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.821033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.821213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.821301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.821395] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.017252] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 774.017627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.324404] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.324584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.324638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.324925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.325038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.325258] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.325358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.325410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.326459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.326459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.326459] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 774.356032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.356203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.356281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.356532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.356681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.367866] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 774.438805] env[65222]: INFO networking_nsxv3.common.synchronization [req-05596a11-b72d-4a65-849f-d327d4b85b1c req-4202c95d-e775-43fb-999d-ff6870b1fa36 service nova] Enqueued Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_rules [ 774.439036] env[65222]: INFO networking_nsxv3.common.synchronization [req-05596a11-b72d-4a65-849f-d327d4b85b1c req-4202c95d-e775-43fb-999d-ff6870b1fa36 service nova] Enqueued Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 774.439133] env[65222]: INFO networking_nsxv3.common.synchronization [req-05596a11-b72d-4a65-849f-d327d4b85b1c req-4202c95d-e775-43fb-999d-ff6870b1fa36 service nova] Enqueued Resource ID: a704841a-7fd3-421b-8fb8-9079401fe3fd with Priority: HIGHEST for action port [ 774.439723] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_rules [ 774.439887] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 774.440072] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a704841a-7fd3-421b-8fb8-9079401fe3fd with Priority: HIGHEST for action port [ 774.440381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.440381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.440381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.440856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.440856] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.442339] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.442459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.442538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.442808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.442975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.443299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.443423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.443484] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.445370] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a704841a-7fd3-421b-8fb8-9079401fe3fd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.445370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.445370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.445370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.445686] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a704841a-7fd3-421b-8fb8-9079401fe3fd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.943385] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.943535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.946077] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.947044] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a704841a-7fd3-421b-8fb8-9079401fe3fd with status ACTIVE [ 774.947243] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.947377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.947453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.947668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.947760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.947941] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.948052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.948155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.948260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.948343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.948508] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.948603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.948661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.948785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.948858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.948970] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a704841a-7fd3-421b-8fb8-9079401fe3fd is going to be updated. [ 774.973337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.973557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.973557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.973804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.973954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.974144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a704841a-7fd3-421b-8fb8-9079401fe3fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.453253] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.588812] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 775.588812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.959924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.959924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.959924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.959924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.959924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.959924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 is going to be created. [ 775.985079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.985079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.985261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.985362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.985530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.997284] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: UNINITIALIZED for 2s [ 776.380285] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 776.380641] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 deletion is rescheduled due to dependency. [ 776.380820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.851986] env[65222]: INFO networking_nsxv3.common.synchronization [req-5b3dd962-05e3-4ac5-a769-dbd1748e7006 req-5b0b8084-6762-4449-bc5c-915e4b77ec16 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 776.855127] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGHEST for action security_group_members [ 776.855127] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.855127] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.855127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.855127] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.357731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.357987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.358127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.358385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.358486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.358728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.358856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.358913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.359083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.359162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.359260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff is going to be updated. [ 777.419321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.419535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.419535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.420147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.420333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.433346] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: IN_PROGRESS for 2s [ 777.929714] env[65222]: INFO networking_nsxv3.common.synchronization [req-36f6f62c-a33a-4a08-b576-3b556d078cf1 req-6a880f02-d072-4302-a7f3-fab0b423f4b7 tempest-ServerRescueTestJSON-1772520455 tempest-ServerRescueTestJSON-1772520455-project-member] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 777.930274] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 777.932130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.932130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.932130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.932354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.933051] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.933051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.933051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.933051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.933262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.933262] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.010035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: SUCCESS [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.010035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.010035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.010493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.010493] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.389304] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.389469] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.389587] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390233] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.390233] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.390416] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.390416] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.391580] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.391580] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.391580] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.391580] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.391580] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.391774] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.391774] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.391935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.413414] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.414019] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.414234] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.414378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-324" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.414742] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-3847a075-0b48-4b1a-9fca-a833813399ad taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.415413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.415413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.415413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.416150] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3847a075-0b48-4b1a-9fca-a833813399ad',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.442249] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.515881] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.516793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.521224] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.521224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.521618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.521618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.521618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.521618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.521745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.521911] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.521965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.522036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.522172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.522244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.522344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.522433] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.917689] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.917927] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.918060] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.918333] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.918477] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.918633] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 3847a075-0b48-4b1a-9fca-a833813399ad not found, creating... [ 778.918899] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.919057] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.919181] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.919831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.919831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.919950] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.920015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.920139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.920455] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.920508] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.920703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 3847a075-0b48-4b1a-9fca-a833813399ad is going to be created. [ 778.944432] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.944760] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.945424] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.945829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.946129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.946407] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.947640] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.024881] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67a33950-b193-4a08-b38a-6d6532bafae7: rpc.has_security_group_logging(os_id): False [ 779.050032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.050032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.050032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.050032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.050365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.050365] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.050483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.050515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.050777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.050878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.051089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.051241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.051324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.051499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.051614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.051908] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.051978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.052028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.052164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.052252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.052391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 is going to be created. [ 779.154565] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.155368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.155368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.155368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.155368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.193679] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: IN_PROGRESS for 2s [ 779.445703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50b6578-c051-4750-b9bb-002f9ba016ff in Status: SUCCESS [ 779.445892] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff deletion is rescheduled due to dependency. [ 779.446028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.450653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.450801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.450866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.451091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.451176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.451267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 779.482554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.482747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.482876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.483069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.483233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.493247] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 779.674317] env[65222]: INFO networking_nsxv3.common.synchronization [req-36f6f62c-a33a-4a08-b576-3b556d078cf1 req-352cd7f3-8cd9-4866-a1f4-65173bb15b93 service nova] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_rules [ 779.674519] env[65222]: INFO networking_nsxv3.common.synchronization [req-36f6f62c-a33a-4a08-b576-3b556d078cf1 req-352cd7f3-8cd9-4866-a1f4-65173bb15b93 service nova] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 779.674657] env[65222]: INFO networking_nsxv3.common.synchronization [req-36f6f62c-a33a-4a08-b576-3b556d078cf1 req-352cd7f3-8cd9-4866-a1f4-65173bb15b93 service nova] Enqueued Resource ID: 3847a075-0b48-4b1a-9fca-a833813399ad with Priority: HIGHEST for action port [ 779.674828] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_rules [ 779.674957] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 779.675098] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3847a075-0b48-4b1a-9fca-a833813399ad with Priority: HIGHEST for action port [ 779.675985] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.675985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.675985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.675985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.676219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.677293] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.677423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.679053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3847a075-0b48-4b1a-9fca-a833813399ad taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.679053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.679053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.679053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.679053] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3847a075-0b48-4b1a-9fca-a833813399ad',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.179807] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.180179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.181379] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3847a075-0b48-4b1a-9fca-a833813399ad with status ACTIVE [ 780.181575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.181717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.181766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.182123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.182123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.182328] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.182433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.182506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.183052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.183052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.183052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.183052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.183298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.183463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.183463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.183548] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3847a075-0b48-4b1a-9fca-a833813399ad is going to be updated. [ 780.207296] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.207702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.207826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.208173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.208358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.208569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3847a075-0b48-4b1a-9fca-a833813399ad" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.211466] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: SUCCESS [ 781.211807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.509824] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 781.510203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.510309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.510570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.510856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.511010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.511134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.511388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.511531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.511660] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.014738] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.517638] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.019883] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.020061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.020168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.020361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.020454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.020584] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 783.094414] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.094414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.094609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.094714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.095780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.107289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 784.677276] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 784.678513] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 785.124601] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 785.124974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.125328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.125539] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.125790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.125943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.126037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.126375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.126495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.126610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.126718] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.631906] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.632115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.632190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.632458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.632637] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.632743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.632810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.632972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.633078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.633172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.633323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.633419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.633481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.633698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.633812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.634106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.634106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.634106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.634106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.634370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.634370] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.728807] env[65222]: INFO networking_nsxv3.common.synchronization [req-2afdf261-99fa-47ae-b4da-edec65e1f1f7 req-30afbd1a-c2c2-4581-990a-742e872791c9 tempest-ImagesNegativeTestJSON-2077925014 tempest-ImagesNegativeTestJSON-2077925014-project-member] Enqueued Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 785.729366] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGHEST for action security_group_members [ 785.729704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.729820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.730309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.730309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.730473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.730473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.731712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.731712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.731712] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.136432] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c338b2c-c780-410a-aac2-962f91390b3f: rpc.has_security_group_logging(os_id): False [ 786.156091] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.156264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.156348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.156576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.156676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.156907] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.157603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.157603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.157811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.157811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.158023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.158197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.158257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.158440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.158534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.158847] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.159008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.159095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.159319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.159711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.159711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 786.234779] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.235119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.235119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.235230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.235374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.238719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.238764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.238955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.239056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.239296] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.239402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.239463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.239969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.239969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.239969] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 is going to be updated. [ 786.268619] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 786.306702] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.306943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.307120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.308070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.308070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.325118] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: IN_PROGRESS for 2s [ 786.482842] env[65222]: INFO networking_nsxv3.common.synchronization [req-b690c521-0706-4325-9af4-109db3350cde req-20820605-bc40-41ee-921c-fca148b5b963 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 786.483847] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 786.484449] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.484705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.484813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.485156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.485437] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.485855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.485855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.485995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.486174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.486369] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.992412] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.992412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.992412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.992885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.992885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.996072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.996072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.996072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.996072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.996072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.996072] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 787.033394] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.033771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.034566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.034907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.035558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.045222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 787.924590] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-76239da7-7526-43cd-8728-1d2f8bb13efc tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 787.925801] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 787.925878] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.926035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.926210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.926618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.927089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.927089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.927089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.927299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.927422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.927647] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.245957] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-beda7945-9440-4928-bbfa-3b188b169391 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 788.246942] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 788.247053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.247136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.287987] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 788.288239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.338568] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67a33950-b193-4a08-b38a-6d6532bafae7 in Status: SUCCESS [ 788.338568] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 deletion is rescheduled due to dependency. [ 788.338568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.429939] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.430136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.430187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.430717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.430717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.430858] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.430916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.430957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.431121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.431197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431287] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 788.431372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.431806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.431997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.432150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.432237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.432414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.432473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.432563] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.611291] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-ca531ee3-511c-4b0e-aac3-c423cefdcbba tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 788.611291] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 788.611455] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.611560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.935215] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.935480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.935601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.935889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.936049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.936356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.936522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.936659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.936864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.936992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.937147] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 788.937295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.937512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.937735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.937944] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.938110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.938223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.938445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.938584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.938730] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.953501] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.954199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.954199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.954199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.954830] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.954830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.954830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.955314] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.955465] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.955686] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.955856] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.955895] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.955995] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.956109] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.956208] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.956334] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.975856] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.976071] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.976181] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.976356] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.976661] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.976828] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.976941] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.977285] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.977421] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('864a4ed5-c60a-4f75-9f93-7f4b51dc0845',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.057328] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 789.057328] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 789.057328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.441709] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.442152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.442152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.442230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.442301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.442500] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.442605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.442670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.442819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.442895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.442979] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 789.443070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.479520] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.480384] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.480384] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.480384] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.480727] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.480727] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 not found, creating... [ 789.480958] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.481135] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.481248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.481477] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.481824] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.481900] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.482184] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.482325] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.482548] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.482682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.482827] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 is going to be created. [ 789.506943] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.506943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.506943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.506943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.507374] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.507529] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.093130] env[65222]: INFO networking_nsxv3.common.synchronization [req-657d370f-4f4e-48d6-894d-f41c76502991 req-b180fabb-d03c-4c63-9793-e28ec67e184b tempest-ServersNegativeTestMultiTenantJSON-616285651 tempest-ServersNegativeTestMultiTenantJSON-616285651-project-member] Enqueued Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 790.093130] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 790.093130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.093448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.093629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.093983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.094246] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.094458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.094606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.094851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-c2824fe5-a8e5-4b87-9b97-7f98cace5652 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-c2824fe5-a8e5-4b87-9b97-7f98cace5652 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-c2824fe5-a8e5-4b87-9b97-7f98cace5652 service nova] Enqueued Resource ID: 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 with Priority: HIGHEST for action port [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 790.220019] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 with Priority: HIGHEST for action port [ 790.220019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.220860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.221260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.221724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.225099] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.225099] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.225099] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.225099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.225099] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.225099] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.226721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.227045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.227440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.229237] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('864a4ed5-c60a-4f75-9f93-7f4b51dc0845',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.483785] env[65222]: INFO networking_nsxv3.common.synchronization [req-c3e2e46a-064d-4a6c-9a55-dd12a5e79d12 req-5345f373-3c8c-450e-8d6d-94010b98b047 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 790.483785] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 790.486862] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.487117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.487560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.487822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.488297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.488721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.488721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.488855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.489018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.489572] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.507153] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.507344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-57" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.507467] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-57" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.507917] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-57" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.508491] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.508655] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.508807] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.509067] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.509225] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.509437] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.509552] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.509684] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.509822] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.509938] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.510105] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.510193] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.531528] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.531528] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.531528] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.531669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-57" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.531939] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-c0ff71ea-7186-4502-983f-5012dfb93571 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.532121] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.532232] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.532543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.532687] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ff71ea-7186-4502-983f-5012dfb93571',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.597984] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.598109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.598109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.598303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.598529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.598745] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.598847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.598912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 already deleted. [ 790.599399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.731048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.731048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.731048] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.731807] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 with status ACTIVE [ 790.731984] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.732112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.732700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.732700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.732700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.732700] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.732700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.733357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.733357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.733357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.733357] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.733495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.733527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.736136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.736136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.736136] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 864a4ed5-c60a-4f75-9f93-7f4b51dc0845 is going to be updated. [ 790.755343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.755501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.755571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.755773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.756705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.756705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-864a4ed5-c60a-4f75-9f93-7f4b51dc0845" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.974050] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.974050] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-251" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.974050] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-251" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.974514] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-251" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.974829] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.975080] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.975248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.975965] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.976177] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.976332] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.976476] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.976626] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.976786] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.976963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.994073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.994341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.994460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.994736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.994875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.995144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.995320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.995437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.995629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.995755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.995882] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 790.998057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.998256] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.998449] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.998654] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-251" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.998978] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-1476683e-87df-43a6-bf06-09cdb5c1cbc2 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.999222] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.999384] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.999768] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.999964] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1476683e-87df-43a6-bf06-09cdb5c1cbc2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.027733] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.027958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.027958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.028263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.028433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.034729] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.034959] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.035129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.035399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.035567] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.035737] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port c0ff71ea-7186-4502-983f-5012dfb93571 not found, creating... [ 791.036015] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.036228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.036349] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.036554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.036682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.036949] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.037108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.037217] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.037415] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.037537] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.037665] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: c0ff71ea-7186-4502-983f-5012dfb93571 is going to be created. [ 791.039111] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 791.056729] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.056916] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.057027] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.057266] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.057473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.057677] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.235653] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.502604] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.502966] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.502966] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.503177] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.503317] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.503466] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 1476683e-87df-43a6-bf06-09cdb5c1cbc2 not found, creating... [ 791.503712] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.503867] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.503976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.504217] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.504348] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.504619] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.504763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.504876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.505083] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.505212] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.505346] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 1476683e-87df-43a6-bf06-09cdb5c1cbc2 is going to be created. [ 791.527467] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.527774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.527931] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.528248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.528473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.528694] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.737717] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.737905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.737971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.738229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.738318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.738422] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be created. [ 791.764133] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.764300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.764340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.764611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.764713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.774580] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: UNINITIALIZED for 2s [ 791.786997] env[65222]: INFO networking_nsxv3.common.synchronization [req-657d370f-4f4e-48d6-894d-f41c76502991 req-3e5d8bd0-1b93-4433-aa8b-60cb69bfc8ae service nova] Enqueued Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_rules [ 791.786997] env[65222]: INFO networking_nsxv3.common.synchronization [req-657d370f-4f4e-48d6-894d-f41c76502991 req-3e5d8bd0-1b93-4433-aa8b-60cb69bfc8ae service nova] Enqueued Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 791.787236] env[65222]: INFO networking_nsxv3.common.synchronization [req-657d370f-4f4e-48d6-894d-f41c76502991 req-3e5d8bd0-1b93-4433-aa8b-60cb69bfc8ae service nova] Enqueued Resource ID: c0ff71ea-7186-4502-983f-5012dfb93571 with Priority: HIGHEST for action port [ 791.787772] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_rules [ 791.787904] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 791.787994] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ff71ea-7186-4502-983f-5012dfb93571 with Priority: HIGHEST for action port [ 791.788285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.789604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.789604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.789604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.789604] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.790173] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.790566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.790566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.790566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.790716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.796273] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.796273] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ff71ea-7186-4502-983f-5012dfb93571 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.796273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.796273] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ff71ea-7186-4502-983f-5012dfb93571',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.239117] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-3f6dc6d2-44f1-4c36-bcf6-2bd96b85d7c6 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 792.239336] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-3f6dc6d2-44f1-4c36-bcf6-2bd96b85d7c6 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 792.239477] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-3f6dc6d2-44f1-4c36-bcf6-2bd96b85d7c6 service nova] Enqueued Resource ID: 1476683e-87df-43a6-bf06-09cdb5c1cbc2 with Priority: HIGHEST for action port [ 792.240049] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 792.240201] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 792.240324] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1476683e-87df-43a6-bf06-09cdb5c1cbc2 with Priority: HIGHEST for action port [ 792.240613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.240749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.241119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.241119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.241251] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1476683e-87df-43a6-bf06-09cdb5c1cbc2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.241377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.241462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.241665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.241776] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1476683e-87df-43a6-bf06-09cdb5c1cbc2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.294115] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.294530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.296638] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.298056] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ff71ea-7186-4502-983f-5012dfb93571 with status ACTIVE [ 792.298797] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.298797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.298797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.298797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.298797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.299046] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.299046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.299046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.299197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.299271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.299451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.299552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.299620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.299769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.299844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.299929] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ff71ea-7186-4502-983f-5012dfb93571 is going to be updated. [ 792.344543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.344749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.344864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.345153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.345337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.345633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ff71ea-7186-4502-983f-5012dfb93571" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750021] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1476683e-87df-43a6-bf06-09cdb5c1cbc2 with status ACTIVE [ 792.750021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.750021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750021] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1476683e-87df-43a6-bf06-09cdb5c1cbc2 is going to be updated. [ 792.773967] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.773967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.773967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.773967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.774371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.774692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1476683e-87df-43a6-bf06-09cdb5c1cbc2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.778685] env[65222]: INFO networking_nsxv3.common.synchronization [req-91ddc098-431c-4a09-92eb-9308553f07f4 req-84a0c756-d8b2-4e6f-98bd-b34fe951a1dc tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 792.779455] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 792.779565] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.780079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.780079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.780079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.780316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.780316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.780443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.780520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.780605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.780698] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.803160] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.032365] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.032365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.032365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.032507] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.032671] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.032821] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.032938] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.033375] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.033552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.033842] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.033992] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.034096] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.034208] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.034293] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.034684] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.034876] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.048945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 793.049093] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 deletion is rescheduled due to dependency. [ 793.049208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.058332] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.058610] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.058798] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.059033] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-733" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.059376] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-94e52770-1091-4c3c-8d5c-2e2382a95888 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.059607] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.059768] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.060106] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.060403] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e52770-1091-4c3c-8d5c-2e2382a95888',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.125399] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.125589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.125706] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.125968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.126230] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.126382] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.126490] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.126690] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.126829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.127038] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.127157] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.127248] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.127349] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.127450] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.127548] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.127704] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.146014] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.146204] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.146314] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.146476] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.146928] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.146928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.147139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.147360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.147491] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca69f0e-3c4e-4cc1-ae85-480b72c52d67',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.282710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.283096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.283096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.283253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.283308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.283487] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.283637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.283734] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.283964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.284100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.284232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 793.308366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.308588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.308588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.308752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.308850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.308956] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 is going to be created. [ 793.322511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.322704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.322747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.322940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.323105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.331998] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 793.344025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.344837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.344837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.344837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.344837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.356175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: UNINITIALIZED for 2s [ 793.563019] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.563313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.563477] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.563663] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.563842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.564047] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 94e52770-1091-4c3c-8d5c-2e2382a95888 not found, creating... [ 793.564292] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.564447] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.564560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.564794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.564952] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.565254] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.565385] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.565498] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.565696] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.565844] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.566019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 94e52770-1091-4c3c-8d5c-2e2382a95888 is going to be created. [ 793.587764] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.588114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.588199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.588450] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.588709] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.588940] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.649987] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.650274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.650400] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.650823] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.650988] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.651411] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port cca69f0e-3c4e-4cc1-ae85-480b72c52d67 not found, creating... [ 793.651717] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.651897] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.652021] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.652386] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.652551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.652864] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.653040] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.653155] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.653371] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.653515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.653658] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: cca69f0e-3c4e-4cc1-ae85-480b72c52d67 is going to be created. [ 793.686765] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.687105] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.687105] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.687392] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.687680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.688111] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.787693] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 793.788195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.788195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.788353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.788464] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.788602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.788673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.788832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.788917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.789025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.789129] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.790211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.790445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.790626] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.790741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.790810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.790961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.791088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.791251] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.285074] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-9a4dbd9a-8dd1-4cdb-953f-b0e6fd24811e service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 794.285074] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-9a4dbd9a-8dd1-4cdb-953f-b0e6fd24811e service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 794.285234] env[65222]: INFO networking_nsxv3.common.synchronization [req-037d02d2-706e-4bf5-bd6c-a019c2040c9e req-9a4dbd9a-8dd1-4cdb-953f-b0e6fd24811e service nova] Enqueued Resource ID: 94e52770-1091-4c3c-8d5c-2e2382a95888 with Priority: HIGHEST for action port [ 794.285722] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 794.285873] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 794.285968] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e52770-1091-4c3c-8d5c-2e2382a95888 with Priority: HIGHEST for action port [ 794.286612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.286755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.286973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287267] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e52770-1091-4c3c-8d5c-2e2382a95888 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.287851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.287851] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e52770-1091-4c3c-8d5c-2e2382a95888',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.293735] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.293849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.294057] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.386714] env[65222]: INFO networking_nsxv3.common.synchronization [req-91ddc098-431c-4a09-92eb-9308553f07f4 req-11d658e5-f3b4-49bd-8490-531f3de3f769 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 794.386714] env[65222]: INFO networking_nsxv3.common.synchronization [req-91ddc098-431c-4a09-92eb-9308553f07f4 req-11d658e5-f3b4-49bd-8490-531f3de3f769 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 794.386714] env[65222]: INFO networking_nsxv3.common.synchronization [req-91ddc098-431c-4a09-92eb-9308553f07f4 req-11d658e5-f3b4-49bd-8490-531f3de3f769 service nova] Enqueued Resource ID: cca69f0e-3c4e-4cc1-ae85-480b72c52d67 with Priority: HIGHEST for action port [ 794.387318] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 794.387456] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 794.387546] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca69f0e-3c4e-4cc1-ae85-480b72c52d67 with Priority: HIGHEST for action port [ 794.388662] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.388812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.388878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.389099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.389328] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.390247] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.390343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.390531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.390643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.390757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.390899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.390975] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca69f0e-3c4e-4cc1-ae85-480b72c52d67',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.789978] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94e52770-1091-4c3c-8d5c-2e2382a95888 with status ACTIVE [ 794.790300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.790365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.790429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.790667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.790773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.790957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.791062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.791129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.791353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.791353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.791536] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.791632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.791727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.791902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.791902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.792025] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94e52770-1091-4c3c-8d5c-2e2382a95888 is going to be updated. [ 794.798318] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.813774] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.813926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.814052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.814211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.814347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.814505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e52770-1091-4c3c-8d5c-2e2382a95888" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.895733] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cca69f0e-3c4e-4cc1-ae85-480b72c52d67 with status ACTIVE [ 794.895968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.897052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.897052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.898107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.898107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.898107] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cca69f0e-3c4e-4cc1-ae85-480b72c52d67 is going to be updated. [ 794.899292] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.899292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.929639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.930252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.930252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.930252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.930252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.930528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cca69f0e-3c4e-4cc1-ae85-480b72c52d67" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.299611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.299611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.300067] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 795.331519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.331661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.331751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.331951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.332110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.343289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 795.343467] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 795.343580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.343752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.343973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.344189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.344307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.344388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.344536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.344615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.344721] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.346263] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 795.366192] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: SUCCESS [ 795.366384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.366556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.366821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.367048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.367728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.367728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.367728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.367728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.368113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.368113] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.847806] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.870345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.870345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.870459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.870690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.870777] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.871025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.871025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.871916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.872134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.872225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.872337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.872433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.872549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.872673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.873601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.873601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.873601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.873601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.873601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.873601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.873601] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.353137] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.376132] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1b8d596-3257-458a-95e4-a89e33ff1f31: rpc.has_security_group_logging(os_id): False [ 796.395021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.395021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.395257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.395299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.395384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.395582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.395690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.395759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.395910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.395990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.396190] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.396286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.396348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.396487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.396558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.397321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.397321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.397321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.397321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.397321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.397321] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 is going to be created. [ 796.454037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.454037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.454037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.454281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.454281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.466405] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: IN_PROGRESS for 2s [ 796.855939] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.856250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.856250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.856832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.856832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.856832] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 796.886379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.886503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.886598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.886780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.886912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.897284] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 797.361274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 797.361478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.361680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.361958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.362245] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.362469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.362540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.362736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.362894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.363179] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.866206] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.112015] env[65222]: INFO networking_nsxv3.common.synchronization [req-d4716df9-89bc-473f-90d2-8baf5f6eab95 req-b3df6b18-b851-4f30-ae2f-847964380904 tempest-ListImageFiltersTestJSON-1062059555 tempest-ListImageFiltersTestJSON-1062059555-project-member] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 798.112779] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGHEST for action security_group_members [ 798.113241] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.113530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.113725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114426] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.116435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.116435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.116435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.116435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.116435] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.370819] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.481684] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: SUCCESS [ 798.481905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.619649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.619649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.619649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.619649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.619649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.619649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.619649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.620156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.620156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.620156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.620156] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be updated. [ 798.647276] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.647474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.647516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.647684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.647868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.658242] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: IN_PROGRESS for 2s [ 798.874083] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.874083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.874083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.874083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.874556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.874556] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 798.908554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 798.908554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.908752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.909040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.909138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.909246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.909336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.909461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.909538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.909623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.909734] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.911353] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.911472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.911617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.911695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.911829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.923200] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 799.414667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.415358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.415358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.415358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.415358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.415556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.415556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.415750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.415750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.417053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.417053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.417053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.417053] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.921431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bedc55f5-0ad2-4b84-aab1-d26ca6737e7a: rpc.has_security_group_logging(os_id): False [ 799.946691] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.950027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.950027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.950027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.951283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.951283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.951283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.951283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.951283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.951283] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 800.035620] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.035852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.035852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.036078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.036282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.054303] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 800.670202] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee in Status: SUCCESS [ 800.670202] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee deletion is rescheduled due to dependency. [ 800.670506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.933228] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 800.933664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.934159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.934293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.934526] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.934669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.934760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.934919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.935015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.935379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.936240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.936752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.937058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.937496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.938484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.938484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.938484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.938484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.938715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.942026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.942175] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.446294] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 013f0bc7-93b5-439a-93c1-4391408844fb: rpc.has_security_group_logging(os_id): False [ 801.470177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.470177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.470177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.470813] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.470813] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be created. [ 801.550266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.550492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.550492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.550741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.550938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.564333] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 801.664962] env[65222]: INFO networking_nsxv3.common.synchronization [None req-9a609563-e09c-4b7a-bdb7-15f9a83b27e0 None None] Enqueued Resource ID: 4ae0202d-ee34-4634-9b05-7f414e73c7d4 with Priority: HIGHEST for action port [ 801.665549] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae0202d-ee34-4634-9b05-7f414e73c7d4 with Priority: HIGHEST for action port [ 801.665865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ae0202d-ee34-4634-9b05-7f414e73c7d4 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.665995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ae0202d-ee34-4634-9b05-7f414e73c7d4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.668796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ae0202d-ee34-4634-9b05-7f414e73c7d4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.668971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ae0202d-ee34-4634-9b05-7f414e73c7d4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.669071] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ae0202d-ee34-4634-9b05-7f414e73c7d4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.075679] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 802.075679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.171944] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ae0202d-ee34-4634-9b05-7f414e73c7d4 [ 802.171944] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.171944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.171944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.171944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.171944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.172820] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ae0202d-ee34-4634-9b05-7f414e73c7d4 already deleted. [ 802.172996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ae0202d-ee34-4634-9b05-7f414e73c7d4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.579969] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 803.580305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.580587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.580700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.580763] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.085791] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.085791] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.085791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.085791] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.264379] env[65222]: INFO networking_nsxv3.common.synchronization [req-e696a289-e296-4d45-b365-80c5b8768bac req-1dd1d493-00c5-46f2-b22e-db735ab9f2f7 tempest-ServerAddressesNegativeTestJSON-2112191271 tempest-ServerAddressesNegativeTestJSON-2112191271-project-member] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 804.265118] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 804.265748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.265748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.265748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.266476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.266476] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.266476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.266476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.266677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.266747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.266869] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.378202] env[65222]: INFO networking_nsxv3.common.synchronization [None req-8e2e809f-2406-4a3b-ba25-10067e86b9e1 None None] Enqueued Resource ID: b9e89017-c3cc-4a73-b7ea-56df91ccf869 with Priority: HIGHEST for action port [ 804.378713] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9e89017-c3cc-4a73-b7ea-56df91ccf869 with Priority: HIGHEST for action port [ 804.379025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9e89017-c3cc-4a73-b7ea-56df91ccf869 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.380146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9e89017-c3cc-4a73-b7ea-56df91ccf869" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.380146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9e89017-c3cc-4a73-b7ea-56df91ccf869" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.380146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9e89017-c3cc-4a73-b7ea-56df91ccf869" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.380146] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e89017-c3cc-4a73-b7ea-56df91ccf869',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.588570] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.588903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.588903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.589129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.590619] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.590619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.590619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.590619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.590619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.590619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.590619] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.591018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.591018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.591018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.591145] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.591188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.591221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.593874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.593874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.593874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.593874] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.769647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.769647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.769833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.770160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.770160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.770412] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.770558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.770673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.770930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.771120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.771218] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11d644ad-a174-4566-8821-3c943c124335 already deleted. [ 804.771354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.782182] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.782592] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-768" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.782912] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-768" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.787192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-768" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.787192] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.787192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.787192] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.790756] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.790756] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.790756] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.790756] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.790756] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.790756] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.790756] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.790756] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.790756] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.811254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.811254] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.811254] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.811254] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-768" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.811254] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-013d6de1-164c-4fc8-8e55-8cc2262013d9 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.811254] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.811254] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.811770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.811770] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013d6de1-164c-4fc8-8e55-8cc2262013d9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.890143] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9e89017-c3cc-4a73-b7ea-56df91ccf869 [ 804.890143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.890143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.890143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.890143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.890143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.890143] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9e89017-c3cc-4a73-b7ea-56df91ccf869 already deleted. [ 804.890143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9e89017-c3cc-4a73-b7ea-56df91ccf869" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.094977] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 013f0bc7-93b5-439a-93c1-4391408844fb: rpc.has_security_group_logging(os_id): False [ 805.117219] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.117219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.117409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.118198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.118344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.118571] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.118686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.118748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.118909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.118978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.119194] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.119292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.119341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.119481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.119553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.119728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.119863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.119943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.120055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.120129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.120216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 805.137135] env[65222]: INFO networking_nsxv3.common.synchronization [req-8704fd10-3416-4a0d-a1c2-fb966ad97a68 req-88cac558-6d0d-4c65-8299-7c45c1cfab8a tempest-ServerRescueTestJSON-1772520455 tempest-ServerRescueTestJSON-1772520455-project-member] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 805.138767] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 805.138767] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.138767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.138894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.139195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.139294] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.139428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.139519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.139713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.139917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.140121] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.144917] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f6c225a5-25d3-487b-8e66-4748833fbfd3 None None] Enqueued Resource ID: af13c8c1-c9de-4cd4-a923-54ef7038cc44 with Priority: HIGHEST for action port [ 805.145705] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af13c8c1-c9de-4cd4-a923-54ef7038cc44 with Priority: HIGHEST for action port [ 805.146354] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-af13c8c1-c9de-4cd4-a923-54ef7038cc44 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.146847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af13c8c1-c9de-4cd4-a923-54ef7038cc44" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.146847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af13c8c1-c9de-4cd4-a923-54ef7038cc44" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.147104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af13c8c1-c9de-4cd4-a923-54ef7038cc44" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.147213] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af13c8c1-c9de-4cd4-a923-54ef7038cc44',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.192918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.193104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.193179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.193355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.193504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.206597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 805.316601] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.316851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.316981] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.317284] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.317429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.317595] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 013d6de1-164c-4fc8-8e55-8cc2262013d9 not found, creating... [ 805.317871] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.318158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.318196] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.318455] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.318614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.318903] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.319079] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.319207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.319412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.319540] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.319673] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 013d6de1-164c-4fc8-8e55-8cc2262013d9 is going to be created. [ 805.344780] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.345108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.345186] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.345426] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.345667] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.345903] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.646113] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.649688] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af13c8c1-c9de-4cd4-a923-54ef7038cc44 [ 805.650363] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.650363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.650363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.650603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.650603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.650603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af13c8c1-c9de-4cd4-a923-54ef7038cc44 already deleted. [ 805.650690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af13c8c1-c9de-4cd4-a923-54ef7038cc44" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.082421] env[65222]: INFO networking_nsxv3.common.synchronization [req-e696a289-e296-4d45-b365-80c5b8768bac req-419ecb8e-8263-424e-a97e-a8b57917276d service nova] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_rules [ 806.082626] env[65222]: INFO networking_nsxv3.common.synchronization [req-e696a289-e296-4d45-b365-80c5b8768bac req-419ecb8e-8263-424e-a97e-a8b57917276d service nova] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 806.082762] env[65222]: INFO networking_nsxv3.common.synchronization [req-e696a289-e296-4d45-b365-80c5b8768bac req-419ecb8e-8263-424e-a97e-a8b57917276d service nova] Enqueued Resource ID: 013d6de1-164c-4fc8-8e55-8cc2262013d9 with Priority: HIGHEST for action port [ 806.083525] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_rules [ 806.083525] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 806.083525] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013d6de1-164c-4fc8-8e55-8cc2262013d9 with Priority: HIGHEST for action port [ 806.083755] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.083897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.083962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.084222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.084314] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.085711] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.085711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.085711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.085711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.086512] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.086512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.086512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.086512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.086512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.086512] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.088368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-013d6de1-164c-4fc8-8e55-8cc2262013d9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.088368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.088368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.088368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.088368] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013d6de1-164c-4fc8-8e55-8cc2262013d9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.149208] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.593936] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.595375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.596014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.596014] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013d6de1-164c-4fc8-8e55-8cc2262013d9 with status ACTIVE [ 806.596014] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.596197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.596357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.596618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.596753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.597014] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.601283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.601400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.601686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.601835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.602160] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.602489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.602489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.602656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.602785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.602924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013d6de1-164c-4fc8-8e55-8cc2262013d9 is going to be updated. [ 806.628701] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.629154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.629238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.629429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.629575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.629749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013d6de1-164c-4fc8-8e55-8cc2262013d9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.654151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.654151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.654151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.654151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.654151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.654151] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 806.684803] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.685550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.685550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.685550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.685917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.696597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 806.769508] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a59e4012-05eb-4454-acd8-c95518ad3f97 None None] Enqueued Resource ID: 1f465307-601a-4ca1-84c8-6ad5e395a1bd with Priority: HIGHEST for action port [ 806.770399] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f465307-601a-4ca1-84c8-6ad5e395a1bd with Priority: HIGHEST for action port [ 806.771060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f465307-601a-4ca1-84c8-6ad5e395a1bd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.771060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f465307-601a-4ca1-84c8-6ad5e395a1bd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.771060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f465307-601a-4ca1-84c8-6ad5e395a1bd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.771687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f465307-601a-4ca1-84c8-6ad5e395a1bd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.771687] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f465307-601a-4ca1-84c8-6ad5e395a1bd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.107754] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.218957] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 807.218957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.218957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.220273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.220273] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.274547] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f465307-601a-4ca1-84c8-6ad5e395a1bd [ 807.274879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.275034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.275107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.275312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.275400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.275502] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f465307-601a-4ca1-84c8-6ad5e395a1bd already deleted. [ 807.275581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f465307-601a-4ca1-84c8-6ad5e395a1bd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.611739] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.611898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.611968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.612248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.612336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.612442] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11d644ad-a174-4566-8821-3c943c124335 is going to be created. [ 807.643226] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.643422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.643422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.643652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.643824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.656094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: UNINITIALIZED for 2s [ 807.721351] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.724672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.724672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.724672] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.973364] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e3c663b-4c28-4da0-9852-5fc4335de200 req-f8be5f2a-dc8e-4858-bc9d-27180fe0d6c9 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 807.974010] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 807.975887] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.976504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.976729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.978070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.978070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.978070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.978070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.978070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.978070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.978562] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.225599] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.225902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.225988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.226559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.226784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.226913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.226970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.227174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.227266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.227356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.227506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.227601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.227679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.227825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.227965] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.228072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.228145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.228284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.228362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.228467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.228526] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.460313] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.460313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.460526] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.460668] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.460930] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461549] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.461752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.461854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.462144] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.462189] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.462364] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.462364] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.462465] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.462917] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.463075] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.480577] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.497580] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.497944] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.498079] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.498295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.498594] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-022c3302-697c-4f49-a50a-aa0c89b69f13 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.498793] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.498912] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.499704] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.499704] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022c3302-697c-4f49-a50a-aa0c89b69f13',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.644041] env[65222]: INFO networking_nsxv3.common.synchronization [req-0afab36d-89be-4aa4-8139-9ca2c7543bb3 req-0e9c760f-8395-475d-bc3b-f2f6843ed923 tempest-FloatingIPsAssociationTestJSON-1856813460 tempest-FloatingIPsAssociationTestJSON-1856813460-project-member] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 808.644041] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGHEST for action security_group_members [ 808.644041] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.644041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.644041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.644041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.644613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.644878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.645083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.646426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.646653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.646841] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.708586] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 808.708850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.731322] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 013f0bc7-93b5-439a-93c1-4391408844fb: rpc.has_security_group_logging(os_id): False [ 808.755216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.755387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.755485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.755639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.755726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.755942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.756091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.756162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.756327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.756448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.756649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.756747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.756810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.757053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.757169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.757406] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.757458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.757510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.757697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.757919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.757919] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 808.835398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.835553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.835626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.836615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.836615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.849663] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 808.985614] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.006998] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.007458] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.007745] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.008185] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.008362] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.008572] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 022c3302-697c-4f49-a50a-aa0c89b69f13 not found, creating... [ 809.008921] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.009145] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.009536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.009536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.009697] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.010290] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.010474] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.010660] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.011304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.011304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.011462] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 022c3302-697c-4f49-a50a-aa0c89b69f13 is going to be created. [ 809.041715] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.041961] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.042227] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.042564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.042863] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.043152] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.149866] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.150162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.150251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.150551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.150675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.150974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.151123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.151212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.151430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.151516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.151616] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be updated. [ 809.213336] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.213653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.213653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.213916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.214138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.227578] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: IN_PROGRESS for 2s [ 809.488255] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.488255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.488418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.488537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.488630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.488779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 809.526568] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.526823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.526891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.527342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.527549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.540982] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 809.598128] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e5d2813-3af6-4eaf-8a97-6b8233040608 req-359abb34-be1b-4dab-8e4f-d4738530bae9 tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 809.598978] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 809.599271] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.599411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.599516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.599684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.599879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.599982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.600065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.600226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.600329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.600408] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.667374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: SUCCESS [ 809.667635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.667834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.668074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.668274] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.668396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.668460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.668596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.668674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.668760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.668848] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.764381] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e3c663b-4c28-4da0-9852-5fc4335de200 req-a6014021-2dba-4a4d-a74f-0ed5a84e4a16 service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 809.764662] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e3c663b-4c28-4da0-9852-5fc4335de200 req-a6014021-2dba-4a4d-a74f-0ed5a84e4a16 service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 809.764662] env[65222]: INFO networking_nsxv3.common.synchronization [req-1e3c663b-4c28-4da0-9852-5fc4335de200 req-a6014021-2dba-4a4d-a74f-0ed5a84e4a16 service nova] Enqueued Resource ID: 022c3302-697c-4f49-a50a-aa0c89b69f13 with Priority: HIGHEST for action port [ 809.765245] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 809.765379] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 809.765477] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022c3302-697c-4f49-a50a-aa0c89b69f13 with Priority: HIGHEST for action port [ 809.765762] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.765892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.765970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.766257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.766353] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.769715] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.769715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.769715] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-022c3302-697c-4f49-a50a-aa0c89b69f13 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.769715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.769715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.769715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.769715] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022c3302-697c-4f49-a50a-aa0c89b69f13',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.966204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.966372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.966698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.966698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.966949] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.067303] env[65222]: INFO networking_nsxv3.common.synchronization [req-c5430ca4-fbfd-43ec-9881-333fa7610fe6 req-26783174-b88d-48a4-a7cc-af846e541f49 tempest-ServersNegativeTestMultiTenantJSON-616285651 tempest-ServersNegativeTestMultiTenantJSON-616285651-project-member] Enqueued Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 810.067860] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGHEST for action security_group_members [ 810.068164] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.068289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.068474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.068694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.068850] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.068974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.069054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.069213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.069298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.069389] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.091498] env[65222]: INFO networking_nsxv3.common.synchronization [req-f81ec2cf-f7b6-4342-b442-6b58ddd20862 req-024a8e13-8ba0-47fb-885f-cf0650ed3aae tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.091498] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.091648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.091742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.091902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.092254] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.092382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.092446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.092600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.092685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.092778] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.103735] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.103918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.104065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.104179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.104271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.104461] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.105707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.105707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.105707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.106547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.106682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be updated. [ 810.138651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.138806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.138869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.139077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.139217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.150778] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 810.172937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.173305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.173406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.173725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.174028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.174149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.174233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.174420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.174554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.174688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.174933] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.175123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.175209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.175381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.175637] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.175795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.175881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.175990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.176209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.176209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.176373] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.270314] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.270314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.271701] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 022c3302-697c-4f49-a50a-aa0c89b69f13 with status ACTIVE [ 810.271931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.272055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.272055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.272266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.272357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.272554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.272630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.272694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.272855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.272941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.273137] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.273224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.273285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.273424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.273496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.273576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 022c3302-697c-4f49-a50a-aa0c89b69f13 is going to be updated. [ 810.310323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.310522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.310610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.310855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.311020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.311204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-022c3302-697c-4f49-a50a-aa0c89b69f13" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.380744] env[65222]: INFO networking_nsxv3.common.synchronization [req-f81ec2cf-f7b6-4342-b442-6b58ddd20862 req-25b1dec1-0c30-4a37-bc40-f904b8e4a902 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.381597] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.381864] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.381864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.469927] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.571800] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.572185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.575017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.575017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.575017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 is going to be updated. [ 810.595627] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.612035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.612035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.612035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.612035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.612035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.623963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: IN_PROGRESS for 2s [ 810.662012] env[65222]: INFO networking_nsxv3.common.synchronization [req-f81ec2cf-f7b6-4342-b442-6b58ddd20862 req-205f248f-78d8-43d5-bb21-2011b2754625 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.662731] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 810.663869] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.664011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.680731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11d644ad-a174-4566-8821-3c943c124335: rpc.has_security_group_logging(os_id): False [ 810.704375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.704542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.704603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.705217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.705217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.705217] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.705217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.705559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.705836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.705913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.706142] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.706236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.706293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.706445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.706519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.706708] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.706792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.706850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.706991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.707109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.707230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11d644ad-a174-4566-8821-3c943c124335 is going to be created. [ 810.781454] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.781891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.782079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.782541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.783416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.798231] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: IN_PROGRESS for 2s [ 810.868118] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 810.868118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.976740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.103622] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.241673] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe in Status: SUCCESS [ 811.241673] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe deletion is rescheduled due to dependency. [ 811.241673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.477759] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 811.477940] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 811.550839] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 811.551056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.551246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.551520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.551736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.552025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.552025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.552162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.552279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.552505] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.607582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.607819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.607939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.608178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.608275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.608375] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 811.646285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.646478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.646568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.646844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.647079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.658407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 812.054954] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.164607] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 812.164814] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 deletion is rescheduled due to dependency. [ 812.164950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.470376] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.470601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.470701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.470965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.488750] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 812.489735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.491319] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 812.538549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.538730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.538778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.546190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.546804] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 812.546894] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.546964] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 812.557786] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.588949] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.589147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.589147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.589257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.591066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.591222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 812.634767] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 in Status: SUCCESS [ 812.634767] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 deletion is rescheduled due to dependency. [ 812.634767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.657540] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.657540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.657540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.657540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.657540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.657540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 812.720416] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.720620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.720620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.720866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.721136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.721404] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 812.721557] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'013f0bc7-93b5-439a-93c1-4391408844fb', '3aaa7263-e1f6-48f6-b26b-4a463242fd35', 'ef0e22a7-af6f-4355-8779-ca32518594be', '8c1005d5-d839-41cb-b881-ed288aaf593d', '2c338b2c-c780-410a-aac2-962f91390b3f', 'e493ec04-5a13-467d-82fd-1b364368163b', '11d644ad-a174-4566-8821-3c943c124335', '1ac38280-989d-45d7-bcb9-03b71f69154c', 'e07da58d-d6f4-45da-8971-0e6a2ab8b846', '18df73a9-aba7-4f1f-b77e-6e993274ef4b', '29dbf536-ddd1-4cbf-a358-4d4757551b70', 'dcfa70a0-ebed-458c-8164-59735a1c9022', '53a4a97d-b980-4164-9506-aae26c06b4c1', '00f008b7-879d-4427-a2d5-c69aea80237d', '7654edec-ade1-480e-832c-a02879a9e17c', '311b5750-44a1-4206-b22b-cccdf5cbdffe', 'cc8b3202-aad0-4507-b032-c8b4d8908623', 'e9f89604-a346-4b24-a7a6-2abb702a4055', 'f1b8d596-3257-458a-95e4-a89e33ff1f31', '934c2ee4-8fd3-4a49-b822-071d800eb172', '9616c573-a4bd-486e-9a65-e040235f1bd2', '4eb5605d-d158-4afb-b319-53f3e5ce181c', 'bbaddab6-0327-438e-a968-548042cf4e7a', '034ec8fb-de90-4302-acab-f4bec595dd2d', 'bedc55f5-0ad2-4b84-aab1-d26ca6737e7a', '6355cca5-8c96-4bbb-bc95-01de745d5b8c', '15ef4155-817c-4a1e-8484-6fde2baef247', '124a99d3-fe24-481b-88c5-184d5a1c99ee', '67a33950-b193-4a08-b38a-6d6532bafae7', '4a1f130e-cc8b-4415-87be-b7a8cbdda189', 'a4c36af1-3224-4449-b91e-20d98bbff745', '44afacd5-bc37-4272-9409-ec05ce0c00f8', '2fbc24f1-8254-4b9b-9b11-d6605f74d8db', '3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3', 'a50b6578-c051-4750-b9bb-002f9ba016ff', '8e8b0390-6b22-4e1a-92fa-1046e5b93e83'} {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.721557] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 812.741206] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.741465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.741465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.741643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.741729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.741842] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 812.741916] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.741979] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 812.802258] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.802437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.802476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.803514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.803514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.803624] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 812.803781] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.803883] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 812.803971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 812.804087] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 812.804180] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGH for action security_group_rules [ 812.804357] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGH for action security_group_rules [ 812.804357] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGH for action security_group_rules [ 812.804424] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGH for action security_group_rules [ 812.804573] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGH for action security_group_rules [ 812.804573] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGH for action security_group_rules [ 812.804646] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGH for action security_group_rules [ 812.804713] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGH for action security_group_rules [ 812.804793] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGH for action security_group_rules [ 812.804875] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGH for action security_group_rules [ 812.804956] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGH for action security_group_rules [ 812.805060] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGH for action security_group_rules [ 812.805144] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGH for action security_group_rules [ 812.805226] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGH for action security_group_rules [ 812.805304] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGH for action security_group_rules [ 812.805384] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGH for action security_group_rules [ 812.805465] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGH for action security_group_rules [ 812.805543] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGH for action security_group_rules [ 812.805622] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGH for action security_group_rules [ 812.805702] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGH for action security_group_rules [ 812.805814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.818750] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: SUCCESS [ 812.819225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.060309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.060603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.060603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.060776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.060968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.061102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 813.091503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.091698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.091775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.092436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.092436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.104631] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 813.107411] env[65222]: INFO networking_nsxv3.common.synchronization [req-0082f8ef-ae26-43b2-8a08-008115638f9b req-08104c13-2da4-4eb7-8fc4-32cb828fb996 tempest-ServersNegativeTestJSON-2124253759 tempest-ServersNegativeTestJSON-2124253759-project-member] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 813.108092] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 813.108245] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGH for action security_group_rules [ 813.108349] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGH for action security_group_rules [ 813.108445] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGH for action security_group_rules [ 813.108539] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7654edec-ade1-480e-832c-a02879a9e17c with Priority: HIGH for action security_group_rules [ 813.108630] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGH for action security_group_rules [ 813.108721] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 with Priority: HIGH for action security_group_rules [ 813.109067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f89604-a346-4b24-a7a6-2abb702a4055 with Priority: HIGH for action security_group_rules [ 813.109067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3202-aad0-4507-b032-c8b4d8908623 with Priority: HIGH for action security_group_rules [ 813.109067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f008b7-879d-4427-a2d5-c69aea80237d with Priority: HIGH for action security_group_rules [ 813.109067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe with Priority: HIGH for action security_group_rules [ 813.109262] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 with Priority: HIGH for action security_group_rules [ 813.109262] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfa70a0-ebed-458c-8164-59735a1c9022 with Priority: HIGH for action security_group_rules [ 813.109320] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 with Priority: HIGH for action security_group_rules [ 813.109397] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b with Priority: HIGH for action security_group_rules [ 813.109472] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 with Priority: HIGH for action security_group_rules [ 813.109552] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e493ec04-5a13-467d-82fd-1b364368163b with Priority: HIGH for action security_group_rules [ 813.109638] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac38280-989d-45d7-bcb9-03b71f69154c with Priority: HIGH for action security_group_rules [ 813.109723] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGH for action security_group_rules [ 813.109807] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 with Priority: HIGH for action security_group_rules [ 813.109970] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1005d5-d839-41cb-b881-ed288aaf593d with Priority: HIGH for action security_group_rules [ 813.110250] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.110367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.110430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.110626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.110778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.110892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.110987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.111115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.111197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.111289] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.113056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113469] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.114203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.114312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.114379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.114526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.114597] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.115329] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.115386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.115421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.115560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.115696] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.116911] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7654edec-ade1-480e-832c-a02879a9e17c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.117060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.117148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.118276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.118366] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7654edec-ade1-480e-832c-a02879a9e17c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.119261] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.119366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.119673] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1b8d596-3257-458a-95e4-a89e33ff1f31 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.119673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.119793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.119834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.119925] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1b8d596-3257-458a-95e4-a89e33ff1f31',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.121454] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f89604-a346-4b24-a7a6-2abb702a4055 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.121454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.121454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.121454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.121454] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f89604-a346-4b24-a7a6-2abb702a4055',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.122467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8b3202-aad0-4507-b032-c8b4d8908623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.122563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.122602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.122754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.122825] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8b3202-aad0-4507-b032-c8b4d8908623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.123624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f008b7-879d-4427-a2d5-c69aea80237d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.123728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.123794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.123940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.124598] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f008b7-879d-4427-a2d5-c69aea80237d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.125869] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-311b5750-44a1-4206-b22b-cccdf5cbdffe taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.125937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.126032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.126229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.126333] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('311b5750-44a1-4206-b22b-cccdf5cbdffe',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.127317] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a4a97d-b980-4164-9506-aae26c06b4c1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.127461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.127555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.127735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.127957] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a4a97d-b980-4164-9506-aae26c06b4c1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.128324] env[65222]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 813.128997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcfa70a0-ebed-458c-8164-59735a1c9022 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.129118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.129184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.129339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.129413] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcfa70a0-ebed-458c-8164-59735a1c9022',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.132021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29dbf536-ddd1-4cbf-a358-4d4757551b70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.132130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.132197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.132347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.132418] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29dbf536-ddd1-4cbf-a358-4d4757551b70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.133212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.133318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.133384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.133530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.133599] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18df73a9-aba7-4f1f-b77e-6e993274ef4b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.134568] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.134568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.134714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.134765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.134810] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07da58d-d6f4-45da-8971-0e6a2ab8b846',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.136312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e493ec04-5a13-467d-82fd-1b364368163b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.136312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.136312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.136312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.136312] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e493ec04-5a13-467d-82fd-1b364368163b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.136823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac38280-989d-45d7-bcb9-03b71f69154c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.136918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.136982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.137138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.137205] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac38280-989d-45d7-bcb9-03b71f69154c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.138020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.138143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.138186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.138323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.138386] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.139591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.139697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.139750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.140549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.140549] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aaa7263-e1f6-48f6-b26b-4a463242fd35',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.140785] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c1005d5-d839-41cb-b881-ed288aaf593d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.140892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.140959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.141619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.141619] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c1005d5-d839-41cb-b881-ed288aaf593d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.143781] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.176508] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.176508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.176508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.176668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.207528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.207528] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be deleted. [ 813.262782] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.262928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.262995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.263212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.263302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.263421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.531992] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.532244] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.532388] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.532652] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.533688] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.534202] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.534338] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.535353] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.535517] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.535750] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.535876] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.536013] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.536145] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.536287] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.536360] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.536538] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.559376] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.559570] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.559786] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.559956] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.560319] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-3dcc5763-fd0f-414c-b55c-5585801b8bed taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.560499] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.560614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.560985] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.561156] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dcc5763-fd0f-414c-b55c-5585801b8bed',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.643575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.643791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.651951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.671746] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.671746] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.671746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.671746] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.677252] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.677252] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.677252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.677575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.677575] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.691990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.692169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.692245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.692597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.692847] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.692933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.692995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.693175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.693264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.693361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.693451] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.705603] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.705732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.705823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.706037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.719180] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.759436] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.759436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.765227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.765349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.766393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.766579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.767244] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.768090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.773614] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.773614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.773879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.774037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07da58d-d6f4-45da-8971-0e6a2ab8b846 is going to be deleted. [ 813.776420] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.776420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.776420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.776883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.780606] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.780700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.781724] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.781791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.783753] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.783841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.785364] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.785482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.786315] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.787124] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.787124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.788499] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.788968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.789224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.790650] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.791220] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.791336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.824057] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.824892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.825274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f89604-a346-4b24-a7a6-2abb702a4055 is going to be deleted. [ 813.826400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.826635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.862049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.862049] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcfa70a0-ebed-458c-8164-59735a1c9022 is going to be deleted. [ 813.862911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.866579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.872983] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.872983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.896099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.896336] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac38280-989d-45d7-bcb9-03b71f69154c is going to be deleted. [ 813.897340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.897630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.913737] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.915077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.062396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.062396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29dbf536-ddd1-4cbf-a358-4d4757551b70 is going to be deleted. [ 814.062396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.062396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.067151] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.067151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.067151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.067151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.067151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.068264] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 3dcc5763-fd0f-414c-b55c-5585801b8bed not found, creating... [ 814.068587] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.068790] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.068894] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.070513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.070513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.071157] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.071157] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.071157] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.071464] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.071537] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.073411] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 3dcc5763-fd0f-414c-b55c-5585801b8bed is going to be created. [ 814.108341] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.108341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.135598] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.135751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.151583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.151759] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f008b7-879d-4427-a2d5-c69aea80237d is going to be deleted. [ 814.152698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.152924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.154605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.154749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.154819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.154992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.155109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.156735] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 814.159141] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.159705] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.159705] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.159819] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.160078] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.160640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.175668] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.175809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.179841] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.180125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.180258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.180596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.180783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.180914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.180975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.181160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.181248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.181340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.181495] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.181587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.181727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.181798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.181931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.182043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.182103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.182269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.182340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.182421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.182510] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.209070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.209276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.209397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.209653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.209880] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.209996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210542] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.211077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.211129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.211269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.211343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.211425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.211513] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.265656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.265913] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 311b5750-44a1-4206-b22b-cccdf5cbdffe is going to be deleted. [ 814.267364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.267763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.287931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.288062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.306459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.306459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.306459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.306459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.306459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.336494] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 814.336945] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.337155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.338468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.338659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a4a97d-b980-4164-9506-aae26c06b4c1 is going to be deleted. [ 814.339821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.340083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.436356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.436569] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aaa7263-e1f6-48f6-b26b-4a463242fd35 is going to be deleted. [ 814.437530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.464120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.464380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.489968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.490225] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c1005d5-d839-41cb-b881-ed288aaf593d is going to be deleted. [ 814.491587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.491844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.536034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.536034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.544690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.544690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.552228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.552228] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8b3202-aad0-4507-b032-c8b4d8908623 is going to be deleted. [ 814.553401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.553401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.605937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.606239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7654edec-ade1-480e-832c-a02879a9e17c is going to be deleted. [ 814.607688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.608046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.660314] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.660530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.674237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.674401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18df73a9-aba7-4f1f-b77e-6e993274ef4b is going to be deleted. [ 814.675538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.675764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.684757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c338b2c-c780-410a-aac2-962f91390b3f: rpc.has_security_group_logging(os_id): False [ 814.713543] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11d644ad-a174-4566-8821-3c943c124335: rpc.has_security_group_logging(os_id): False [ 814.718151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.718151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.729710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.729710] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1b8d596-3257-458a-95e4-a89e33ff1f31 is going to be deleted. [ 814.731010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.731452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.746563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.746713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.774290] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e493ec04-5a13-467d-82fd-1b364368163b is going to be deleted. [ 814.775319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.775550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.775642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07da58d-d6f4-45da-8971-0e6a2ab8b846" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.776388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f89604-a346-4b24-a7a6-2abb702a4055" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.777144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.777188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.777385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.777385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcfa70a0-ebed-458c-8164-59735a1c9022" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.777567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.777659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.777838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.778095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac38280-989d-45d7-bcb9-03b71f69154c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.778095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.778318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.778318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.778537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.778650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.778721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.778901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.779015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.779120] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be deleted. [ 814.780600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.780600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.780600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.780600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29dbf536-ddd1-4cbf-a358-4d4757551b70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.780600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.780945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.780945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.780945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f008b7-879d-4427-a2d5-c69aea80237d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.781466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.781716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.781790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.781920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-311b5750-44a1-4206-b22b-cccdf5cbdffe" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.782194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.782271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a4a97d-b980-4164-9506-aae26c06b4c1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.782657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.782732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aaa7263-e1f6-48f6-b26b-4a463242fd35" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.783150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.783249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.783358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c1005d5-d839-41cb-b881-ed288aaf593d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.783498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.783719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.783801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.783951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8b3202-aad0-4507-b032-c8b4d8908623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.784852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.785042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.829026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.829161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.831919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.831919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.838464] env[65222]: INFO networking_nsxv3.common.synchronization [req-0082f8ef-ae26-43b2-8a08-008115638f9b req-1b3ea162-5ce6-4b40-8444-30977fd353dd service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 814.838898] env[65222]: INFO networking_nsxv3.common.synchronization [req-0082f8ef-ae26-43b2-8a08-008115638f9b req-1b3ea162-5ce6-4b40-8444-30977fd353dd service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 814.839051] env[65222]: INFO networking_nsxv3.common.synchronization [req-0082f8ef-ae26-43b2-8a08-008115638f9b req-1b3ea162-5ce6-4b40-8444-30977fd353dd service nova] Enqueued Resource ID: 3dcc5763-fd0f-414c-b55c-5585801b8bed with Priority: HIGHEST for action port [ 814.839642] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 814.839791] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 814.840105] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dcc5763-fd0f-414c-b55c-5585801b8bed with Priority: HIGHEST for action port [ 814.840452] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.840556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.841285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.841285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.841285] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dcc5763-fd0f-414c-b55c-5585801b8bed taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.841484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.841484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.841673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.841753] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dcc5763-fd0f-414c-b55c-5585801b8bed',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.854366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.854727] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.854881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.854881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.855729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.855729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.855729] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.855729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.856198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.856198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.856198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.856840] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.856840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.856840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.856840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.856840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.857146] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 814.858049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.858503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.860533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.861267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.878236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.878701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.878701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.878848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.879008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.879167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.879335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.879506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.879702] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.879809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.879948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.880345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.880345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.880448] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.889031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.889031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.889031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.889031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.890244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.890444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.890656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.890801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.890943] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11d644ad-a174-4566-8821-3c943c124335 is going to be updated. [ 814.892567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.892772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.892880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.893050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7654edec-ade1-480e-832c-a02879a9e17c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.893445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.893445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.893641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.893641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18df73a9-aba7-4f1f-b77e-6e993274ef4b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.893825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.894144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.894144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.894306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1b8d596-3257-458a-95e4-a89e33ff1f31" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.974308] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.974512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.974512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.974743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.974826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.974950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e493ec04-5a13-467d-82fd-1b364368163b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.067447] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.067929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.067929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.067929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.068102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.107640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 815.121962] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 815.122310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.122513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.122718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.122923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.123054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.123125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.123309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.123349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.123435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.123525] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.167788] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 815.167788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.167788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.167788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.167788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.167788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.202936] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: IN_PROGRESS for 2s [ 815.347659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dcc5763-fd0f-414c-b55c-5585801b8bed with status ACTIVE [ 815.348093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.348281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.348345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.348590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.348683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.348924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.349164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.349164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.349318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.349318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.349528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.349659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.349659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.349901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.349976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.350139] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dcc5763-fd0f-414c-b55c-5585801b8bed is going to be updated. [ 815.383161] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.383349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.383425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.383758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.383859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.384162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.384286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.384353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.384524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.384609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.384703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 815.384786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.386367] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.386497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.386573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.386747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.386886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.387078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dcc5763-fd0f-414c-b55c-5585801b8bed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.626141] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.626328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.626572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.626698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.626862] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.626965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.627034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.627198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.627287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.627376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.627524] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.627618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.627691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.627838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.627978] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.628083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.628139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.628448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.628448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.628558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.628643] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.979038] env[65222]: INFO networking_nsxv3.common.synchronization [req-c60a0a50-8199-4af3-a6e9-d61c02a2a37e req-cedbcda8-b647-4ae5-916e-9527337122a5 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 815.979446] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 815.980824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.980824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.980824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.982317] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.131505] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934c2ee4-8fd3-4a49-b822-071d800eb172: rpc.has_security_group_logging(os_id): False [ 816.154453] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.154636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.154682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.155773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.179457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.179731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.179948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.181671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.181834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.184356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.184356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.184356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.184356] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 816.259215] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.259394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.259468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.259679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.259830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.274637] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 816.352312] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 816.352495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.353535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.357060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.357060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.357060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.357060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.357060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.357545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.357545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.357545] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.358367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.358578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.359690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.359690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.359690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.359690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.359690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.359690] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.397063] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.397063] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.397063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.397063] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.397063] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.398109] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.398391] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.398620] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.398833] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.399108] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.422209] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.422700] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.422997] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.423301] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.423760] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2530fd56-7639-40e4-8e35-6e66ec2094ac taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.424127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.424385] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.425305] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.425572] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2530fd56-7639-40e4-8e35-6e66ec2094ac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.483537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.483669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.483733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.484093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.507691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.508340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.508340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.508340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.508532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.508532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.508611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 816.534312] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.534461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.534530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.534754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.534898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.544645] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 816.553714] env[65222]: INFO networking_nsxv3.common.synchronization [req-f422aa24-1af5-4584-8853-8ca673d81e49 req-92edca11-005d-4de1-b053-06655ff5921c tempest-ServerAddressesNegativeTestJSON-2112191271 tempest-ServerAddressesNegativeTestJSON-2112191271-project-member] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 816.553714] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGHEST for action security_group_members [ 816.554765] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.554765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.554765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.554765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.554918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.556142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.556142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.556142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.556142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.556142] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.862119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.862119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.863321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.928679] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.928922] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.930304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.930304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.930304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.930304] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 2530fd56-7639-40e4-8e35-6e66ec2094ac not found, creating... [ 816.930304] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.930304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.930304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.930764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.930764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.930975] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.931170] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.931305] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.931536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.931686] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.931863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2530fd56-7639-40e4-8e35-6e66ec2094ac is going to be created. [ 816.953175] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.953394] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.953517] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.953786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.954016] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.954247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.057887] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.058184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.058184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.058976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.058976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.059711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11d644ad-a174-4566-8821-3c943c124335 is going to be updated. [ 817.118206] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.118393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.118457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.118668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.118873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.130992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 817.131202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.131898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: IN_PROGRESS for 2s [ 817.215838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: SUCCESS [ 817.216702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.366714] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.686437] env[65222]: INFO networking_nsxv3.common.synchronization [req-c60a0a50-8199-4af3-a6e9-d61c02a2a37e req-22ae5e51-7c62-4fea-b275-90f6b8b1cc78 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 817.686671] env[65222]: INFO networking_nsxv3.common.synchronization [req-c60a0a50-8199-4af3-a6e9-d61c02a2a37e req-22ae5e51-7c62-4fea-b275-90f6b8b1cc78 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 817.686805] env[65222]: INFO networking_nsxv3.common.synchronization [req-c60a0a50-8199-4af3-a6e9-d61c02a2a37e req-22ae5e51-7c62-4fea-b275-90f6b8b1cc78 service nova] Enqueued Resource ID: 2530fd56-7639-40e4-8e35-6e66ec2094ac with Priority: HIGHEST for action port [ 817.687368] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 817.687513] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 817.687631] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2530fd56-7639-40e4-8e35-6e66ec2094ac with Priority: HIGHEST for action port [ 817.688651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.688767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.688837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.689070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.689150] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.690060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2530fd56-7639-40e4-8e35-6e66ec2094ac taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.691025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.691229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.691471] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2530fd56-7639-40e4-8e35-6e66ec2094ac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.869440] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.869440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.869639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.869726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.869817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.869969] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 817.900620] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.900788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.900852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.901103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.901279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.912040] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 818.197021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.197021] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2530fd56-7639-40e4-8e35-6e66ec2094ac with status ACTIVE [ 818.197021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.197021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.197021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.197021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.197947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.197947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.197947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.197947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.197947] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2530fd56-7639-40e4-8e35-6e66ec2094ac is going to be updated. [ 818.221946] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.221946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.221946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.221946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.221946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.221946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2530fd56-7639-40e4-8e35-6e66ec2094ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.302463] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 818.302463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.302463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.304030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.304030] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.560783] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 818.561014] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 818.561414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.561633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.562247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.562465] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.562599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.562644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.562814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.562914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.563045] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.809042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.809214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.809214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.809463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.809649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.809753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.809867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.810079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.810151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.810260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.810303] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.066935] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.142660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11d644ad-a174-4566-8821-3c943c124335 in Status: SUCCESS [ 819.142859] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11d644ad-a174-4566-8821-3c943c124335 deletion is rescheduled due to dependency. [ 819.142974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.312744] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.313062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.313062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.313221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.313394] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.313495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.313548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.313703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.313790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.313879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.314048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.314145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.314206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.314348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.314490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.314583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.314643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.314777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.314850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.314929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.315028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.569497] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.812089] env[65222]: INFO networking_nsxv3.common.synchronization [req-987ea020-51a6-4c93-87bb-d7359944b911 req-67094b63-171f-4286-af29-4825169669d3 tempest-VolumesAssistedSnapshotsTest-1127806725 tempest-VolumesAssistedSnapshotsTest-1127806725-project-member] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 819.812681] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGHEST for action security_group_members [ 819.813036] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.817314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.817314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.817557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.817702] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.817853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.817901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.818019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.818111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.818209] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.819567] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934c2ee4-8fd3-4a49-b822-071d800eb172: rpc.has_security_group_logging(os_id): False [ 819.839538] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.839538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.839538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.839804] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.839928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.840171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.840334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.840419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.840599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.840701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.840937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.841900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.841900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.842223] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 819.903797] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.903958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.904140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.904347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.904523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.920667] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 819.921224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.921224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.921421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.921587] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.921698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.921753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.921909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.921993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.922094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.922249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.922336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.922393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.922538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.922667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.922757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.922809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.922945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.923040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.923120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.923370] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.924646] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 820.073656] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.074156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.074303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.075137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.075265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.075348] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 820.121249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.121249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.121249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.121249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.121620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.133695] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 820.321746] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.322133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.322133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.322293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.363084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.363445] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.363623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.363667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.363859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.363952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.364611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 is going to be updated. [ 820.396541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.396722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.397100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.397100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.397218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.406972] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: IN_PROGRESS for 2s [ 820.426766] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef0e22a7-af6f-4355-8779-ca32518594be: rpc.has_security_group_logging(os_id): False [ 820.447315] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.447315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.447315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.447315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.468398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.468691] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.469556] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.469556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.470103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.470103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.470103] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.470103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.470330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.470330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.470431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.470431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 820.510663] env[65222]: INFO networking_nsxv3.common.synchronization [None req-6b39dff5-f0a4-4bec-928e-374377badaec tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 820.511075] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 820.511404] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.511519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.511610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.511870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.511959] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.558961] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.558961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.559211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.559249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.559404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.575117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 820.649531] env[65222]: INFO networking_nsxv3.common.synchronization [None req-554998f1-b487-409f-864a-d45ebe18cf20 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 820.650114] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 820.650440] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.650545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.034456] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.034677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.034761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.035338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.035338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.035338] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7d31cf-9989-4765-9a76-058b268adcef already deleted. [ 821.035338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.035548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.035580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.035742] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.557798] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.557798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.557798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.558263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.558263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.558263] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7d31cf-9989-4765-9a76-058b268adcef already deleted. [ 821.558263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.955200] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 821.955473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.986208] env[65222]: INFO networking_nsxv3.common.synchronization [req-a9110a70-439d-43dc-a3e5-92a42e777f0a req-33b5d31f-1455-4aa5-ab62-1d7a666f2094 tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 821.986786] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 821.989340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.989510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.989554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.989835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.990129] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.990254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.990320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.991036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.991036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.991036] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.144716] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 822.144716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.146050] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.146050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.146050] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.402554] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.402775] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.402924] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.403302] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.403731] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.403806] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.403854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.404123] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.404337] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.404565] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.404691] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.404792] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.404949] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.405024] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.405115] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.405288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.566602] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 in Status: SUCCESS [ 822.566894] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 deletion is rescheduled due to dependency. [ 822.566894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.567744] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.567917] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.163 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.568107] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.568260] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.568578] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-9f970ec7-4dcb-4fc0-acce-0a702c165163 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.568770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.571716] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.571716] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.571716] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f970ec7-4dcb-4fc0-acce-0a702c165163',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.571716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.571716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.571716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.572082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.572082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.572253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.572253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.572253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.572424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.572483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.572576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 already deleted. [ 822.572707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.590375] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 822.590587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.590838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.590997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.591100] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.650034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.650249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.650341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.650521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.650728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.650854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.650998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.651121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.651242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.651340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.651435] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.651546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.651602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.651846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.651919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.652023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.652098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.652740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.652740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.652740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.652740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.077062] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.077480] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.077713] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.078097] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.078322] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.078542] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 9f970ec7-4dcb-4fc0-acce-0a702c165163 not found, creating... [ 823.078899] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.079147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.079299] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.079560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.079770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.080213] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.080430] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.080565] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.080796] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.081058] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.081253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 9f970ec7-4dcb-4fc0-acce-0a702c165163 is going to be created. [ 823.094343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.094669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.094669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.094796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.094921] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.095586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.095586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.095586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.095586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.095586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.095845] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.107478] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.107780] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.107780] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.108019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.108354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.108598] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.156802] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 823.176980] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.176980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.178227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.179213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.179213] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.179213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.179213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.179213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.179213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.179659] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.179659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.179776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.179980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.181023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.181023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 823.295989] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.296235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.296235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.296693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.296921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.311468] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 823.598407] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.598802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.598802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.599023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.599227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.599336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.599414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.599671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.599779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.599873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.600113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.600315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.600315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.600441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.600571] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.600649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.600722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.600888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.600976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.601060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.601152] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.743413] env[65222]: INFO networking_nsxv3.common.synchronization [req-a9110a70-439d-43dc-a3e5-92a42e777f0a req-6fa5cdc1-fa44-48df-808a-9e01f5e12ac9 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 823.743699] env[65222]: INFO networking_nsxv3.common.synchronization [req-a9110a70-439d-43dc-a3e5-92a42e777f0a req-6fa5cdc1-fa44-48df-808a-9e01f5e12ac9 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 823.743781] env[65222]: INFO networking_nsxv3.common.synchronization [req-a9110a70-439d-43dc-a3e5-92a42e777f0a req-6fa5cdc1-fa44-48df-808a-9e01f5e12ac9 service nova] Enqueued Resource ID: 9f970ec7-4dcb-4fc0-acce-0a702c165163 with Priority: HIGHEST for action port [ 823.744407] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 823.744521] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 823.744637] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f970ec7-4dcb-4fc0-acce-0a702c165163 with Priority: HIGHEST for action port [ 823.745598] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.745850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.745850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.746635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.746635] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.747353] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.747771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.747892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.748227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.748398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.748507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.748566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.748714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.748799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.749019] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.750076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f970ec7-4dcb-4fc0-acce-0a702c165163 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.751346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.751436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.751596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.751654] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f970ec7-4dcb-4fc0-acce-0a702c165163',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.103740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef0e22a7-af6f-4355-8779-ca32518594be: rpc.has_security_group_logging(os_id): False [ 824.127068] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.127068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.127068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.127326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.127326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.127581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.127693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.127758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.127919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.128017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.128279] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.128414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.128475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.128652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.128745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.128962] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.129082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.129213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.129330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.129414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.129494] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 824.205130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.205289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.205359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.205577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.205833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.220739] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 824.253169] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.254247] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.254390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.255682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f970ec7-4dcb-4fc0-acce-0a702c165163 with status ACTIVE [ 824.255792] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.255895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.255959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.256276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.256276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.256467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.256554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.256634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.256797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.256873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.257131] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.257228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.257228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.257347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.257420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.257505] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f970ec7-4dcb-4fc0-acce-0a702c165163 is going to be updated. [ 824.286025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.286206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.286206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.286352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.286489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.286789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f970ec7-4dcb-4fc0-acce-0a702c165163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.760008] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.265384] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.265384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.265384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.265384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.265384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.265384] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be created. [ 825.311482] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.311683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.311742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.311952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.312131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.324623] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: UNINITIALIZED for 2s [ 825.328663] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 825.328964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.029412] env[65222]: INFO networking_nsxv3.common.synchronization [req-5348e0d3-146f-42fa-ac7c-eb26808591e3 req-45a2421b-b93d-453e-9da7-077f379c2c32 tempest-ServersNegativeTestJSON-2124253759 tempest-ServersNegativeTestJSON-2124253759-project-member] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 826.030123] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 826.030509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.030632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.030699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.030894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.031147] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.031342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.031419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.031607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.031690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.031785] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.241671] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 826.241910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.534715] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.037205] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.334324] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 827.334731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.334731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.334925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.335133] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.335256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.335313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.335460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.335538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.335623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.335713] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.539924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.540172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.540255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.540660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.540660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.540660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 827.568228] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.568470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.568588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.569126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.569126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.579700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 827.840212] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.343175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba84537-4aba-48c8-aa91-19210e1c0cf1: rpc.has_security_group_logging(os_id): False [ 828.366890] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.366890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.366890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.366890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.366890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.366890] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.366890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.367364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.367364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.367364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.367364] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be created. [ 828.433667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.433819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.434233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.434474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.434655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.453555] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 829.591030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 829.591373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.470991] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 830.471277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.616133] env[65222]: INFO networking_nsxv3.common.synchronization [req-873c733c-0bc6-4f57-b1de-60dc6e9c1498 req-8fcdea0a-ffb9-4404-b9b9-46dc094d2d9d tempest-AttachInterfacesV270Test-1294194867 tempest-AttachInterfacesV270Test-1294194867-project-member] Enqueued Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 830.616812] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 830.617148] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.617266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.617330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.617599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.617874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.617874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.618049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.618603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.618603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.618603] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.044842] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-321 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.045120] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-321" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.045262] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-321" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.045515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-321" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.045918] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.046317] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.046425] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.046682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.046792] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.046987] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.047090] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.047214] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.047397] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.047583] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.047769] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.048080] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.071748] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.071911] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.071992] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.072189] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-321" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.072753] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.072874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.073138] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.073488] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.073601] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64e87b3-cbf4-4fa9-b769-73d22fbbf50d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.121620] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.121920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.121920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.122227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.122342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.122659] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.122790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.122790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.122915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.122974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.123072] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff already deleted. [ 831.123144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.579110] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.579405] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.579485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.579772] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.579944] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.580173] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port e64e87b3-cbf4-4fa9-b769-73d22fbbf50d not found, creating... [ 831.580460] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.580620] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.580735] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.580967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.581193] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.581509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.581663] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.581776] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.581989] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.582133] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.582272] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: e64e87b3-cbf4-4fa9-b769-73d22fbbf50d is going to be created. [ 831.607405] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.607747] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.608068] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.608473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.608857] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.609215] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.356410] env[65222]: INFO networking_nsxv3.common.synchronization [req-873c733c-0bc6-4f57-b1de-60dc6e9c1498 req-48b5b37e-7ab0-40eb-956e-bfc255d2ee38 service nova] Enqueued Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_rules [ 832.356836] env[65222]: INFO networking_nsxv3.common.synchronization [req-873c733c-0bc6-4f57-b1de-60dc6e9c1498 req-48b5b37e-7ab0-40eb-956e-bfc255d2ee38 service nova] Enqueued Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 832.356836] env[65222]: INFO networking_nsxv3.common.synchronization [req-873c733c-0bc6-4f57-b1de-60dc6e9c1498 req-48b5b37e-7ab0-40eb-956e-bfc255d2ee38 service nova] Enqueued Resource ID: e64e87b3-cbf4-4fa9-b769-73d22fbbf50d with Priority: HIGHEST for action port [ 832.357342] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_rules [ 832.357457] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 832.357550] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e87b3-cbf4-4fa9-b769-73d22fbbf50d with Priority: HIGHEST for action port [ 832.357861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.357995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.358089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.358340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.358418] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.359352] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.359468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.359608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.360524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.360524] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.360524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.360524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.360524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.360524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.360524] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.362182] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.362364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.362616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.362748] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64e87b3-cbf4-4fa9-b769-73d22fbbf50d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.864989] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.865160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.865367] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.866355] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64e87b3-cbf4-4fa9-b769-73d22fbbf50d with status ACTIVE [ 832.866714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.866813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.866874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.867188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.867244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.868061] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.868061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.868061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.868061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.868061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.868403] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.868497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.868599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.869576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.869576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.869576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64e87b3-cbf4-4fa9-b769-73d22fbbf50d is going to be updated. [ 832.896253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.896531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.896819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.897093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.897252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.897418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64e87b3-cbf4-4fa9-b769-73d22fbbf50d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.372686] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.875469] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.875743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.876489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.876846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.877258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.877463] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff is going to be created. [ 833.905264] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.905264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.905264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.905264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.906140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.917319] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: UNINITIALIZED for 2s [ 835.930518] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: SUCCESS [ 835.930518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.930518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.930518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.930959] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.930959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.930959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.930959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.931148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.931148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.931216] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.433981] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.434416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.434416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.434653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.434958] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.435081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.435134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.435562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.435562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.435658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.435814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.435934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.436014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.436242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.436419] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.436578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.436694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.436878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.436985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.437186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.437375] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.941126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9115f62f-c7b4-4e8a-b399-29989bafdeff: rpc.has_security_group_logging(os_id): False [ 836.963511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.963511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.963511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.963726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.963726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.963922] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.964040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.964104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.964238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.964313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.964503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.964597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.964661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.964796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.964869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.965064] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.965160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.965221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.965357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.965429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.965512] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff is going to be created. [ 837.058550] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.059770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.059770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.059770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.059770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.072663] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: IN_PROGRESS for 2s [ 837.358918] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 837.360185] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 837.481052] env[65222]: INFO networking_nsxv3.common.synchronization [None req-db1c4663-c8f3-48af-8f9a-8cb4e2fe052d None None] Enqueued Resource ID: a653c383-bb44-4f3a-b2ea-8625ee9dab36 with Priority: HIGHEST for action port [ 837.482073] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a653c383-bb44-4f3a-b2ea-8625ee9dab36 with Priority: HIGHEST for action port [ 837.482584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a653c383-bb44-4f3a-b2ea-8625ee9dab36 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.482776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a653c383-bb44-4f3a-b2ea-8625ee9dab36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.482880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a653c383-bb44-4f3a-b2ea-8625ee9dab36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.483647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a653c383-bb44-4f3a-b2ea-8625ee9dab36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.483647] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a653c383-bb44-4f3a-b2ea-8625ee9dab36',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.671182] env[65222]: INFO networking_nsxv3.common.synchronization [req-b928fc1f-907e-46f7-87ed-a561c1f702cb req-aac21016-6930-4149-9a3c-158ae6983328 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 837.671744] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 837.672078] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.672209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.672280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.672557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.672727] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.672833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.672897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.675309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.675435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.675544] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.986604] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a653c383-bb44-4f3a-b2ea-8625ee9dab36 [ 837.986604] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.986604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.986604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.986604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.987102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.987102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a653c383-bb44-4f3a-b2ea-8625ee9dab36 already deleted. [ 837.987102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a653c383-bb44-4f3a-b2ea-8625ee9dab36" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.041970] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.042181] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.042296] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.042569] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.042818] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.042960] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.043113] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.043283] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.043424] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.043622] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.043726] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.043826] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.043927] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.044065] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.044170] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.044297] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.074385] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.074599] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.074762] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.074958] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.075522] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.075983] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.076140] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ec8e86a-a554-44a6-9fc2-d6dbb0d88106',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.178631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.178821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.178899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.179146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.200519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.200818] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.200940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.201017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.201248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.201339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.201459] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 838.232521] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.232744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.233264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.233492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.233652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.244301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 838.578568] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.578794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.578913] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.579260] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.579409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.582026] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 not found, creating... [ 838.582211] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.582489] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.582627] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.582903] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.583054] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.583434] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.583624] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.583755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.583991] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.584187] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.584359] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 is going to be created. [ 838.614631] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.615230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.615230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.615353] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.615551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.615781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.091037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: SUCCESS [ 839.091037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.448463] env[65222]: INFO networking_nsxv3.common.synchronization [req-b928fc1f-907e-46f7-87ed-a561c1f702cb req-cfc680b2-c816-49ad-912d-b6425a032e0f service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 839.448655] env[65222]: INFO networking_nsxv3.common.synchronization [req-b928fc1f-907e-46f7-87ed-a561c1f702cb req-cfc680b2-c816-49ad-912d-b6425a032e0f service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 839.448790] env[65222]: INFO networking_nsxv3.common.synchronization [req-b928fc1f-907e-46f7-87ed-a561c1f702cb req-cfc680b2-c816-49ad-912d-b6425a032e0f service nova] Enqueued Resource ID: 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 with Priority: HIGHEST for action port [ 839.449437] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 839.449624] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 839.449683] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 with Priority: HIGHEST for action port [ 839.450369] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.450501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.450543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.450744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.450828] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.451759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.451855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.452076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.452186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.452252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.452442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.452512] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ec8e86a-a554-44a6-9fc2-d6dbb0d88106',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.954324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.954498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.954664] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 with status ACTIVE [ 839.954839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.954945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.955019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.955242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.955345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.955523] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.955616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.955691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.955850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.955964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.956154] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.956332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.956332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.956449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.956509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.956585] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ec8e86a-a554-44a6-9fc2-d6dbb0d88106 is going to be updated. [ 840.020197] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.020406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.020534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.020708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.020852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.021513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ec8e86a-a554-44a6-9fc2-d6dbb0d88106" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.279085] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 840.279085] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 840.279085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.279457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.279457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.279628] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.279816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.279816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.279915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.279992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.280193] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.329455] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e108572a-839c-48cd-b5ad-e85794f5dade None None] Enqueued Resource ID: 2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de with Priority: HIGHEST for action port [ 840.330237] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de with Priority: HIGHEST for action port [ 840.330753] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.330753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.330753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.331016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.331193] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.783403] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.837020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de [ 840.837020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.837020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.837020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.837020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.837020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.837020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de already deleted. [ 840.837020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5a8ab2-9ac2-44c6-8c93-c4346f05d0de" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.286073] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.615801] env[65222]: INFO networking_nsxv3.common.synchronization [req-aaa7cdd1-d602-4b15-82e1-96f7e28a4b4d req-65f90b9c-f6a3-42a0-93b1-7d830c6ba01e tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 841.616379] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 841.616697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.616821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.616888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.617103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.617263] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.617358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.617421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.617574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.617657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.617750] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.789565] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.789565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.789565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.789565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.789565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.789565] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 841.819155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.819358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.819358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.819574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.819716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.828660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 842.120417] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.120644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.120723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.121035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.121147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.121419] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.121529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.121592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.121810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.121893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.121983] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 842.162340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.162602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.162602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.162789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.163025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.173833] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 843.840847] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 843.840847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841421] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.841543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.841610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.842068] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.184501] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 844.184682] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 844.184798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.344597] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.344809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.344884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.345129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.345306] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.345444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.345486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.345616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.346320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.346320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.346320] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.346320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.346320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.346320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.346593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.346593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.346593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.346694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.346725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.346815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.346869] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.849623] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 844.870429] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.870665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.870806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.871288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.871439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.871795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.871962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.872089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.872345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.875019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.875019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.875019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.875019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 844.943872] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.944056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.944100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.944393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.944564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.958037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 846.617371] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 846.617683] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 846.666131] env[65222]: INFO networking_nsxv3.common.synchronization [req-4854c6b2-fcf3-4161-80b7-9657f4170895 req-881d57c2-55cd-46ba-a786-71136f90f745 tempest-AttachInterfacesV270Test-1294194867 tempest-AttachInterfacesV270Test-1294194867-project-member] Enqueued Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 846.666740] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGHEST for action security_group_members [ 846.667079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.667215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.667276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.667515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.667669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.667771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.667836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.667970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.668342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.668484] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.974543] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 846.974778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.171187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.171487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.171487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.171731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.171882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.172098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.172241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.172303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.172472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.172609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.172678] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff is going to be updated. [ 847.202594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.202594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.202594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.202911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.215943] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: IN_PROGRESS for 2s [ 848.070428] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-054e9123-7006-489d-ad0b-8beeeab7f7b3 tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 848.071582] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 848.071582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.071582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.071582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.071844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.071931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.072112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.072112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.072281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.072343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.072539] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.435887] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.435887] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.435887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.435887] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.436479] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.436479] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.436479] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.436479] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.436479] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.437179] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.477169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.477169] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.477169] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.477169] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.477779] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.477779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.477779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.478068] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.478307] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a752d4-1f8c-4c8d-a49d-5e9a22096fec',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.574947] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.575355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.575452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.575668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.617701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.618012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.618208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.618332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.618456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.618540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.618633] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 848.664861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.665163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.666509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.666797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.667013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.676971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 848.854945] env[65222]: INFO networking_nsxv3.common.synchronization [None req-50d1ab7a-2a09-4ab6-b2cf-2791a1edc5e8 None None] Enqueued Resource ID: 2535b406-5534-4071-a5f3-406c57450206 with Priority: HIGHEST for action port [ 848.854945] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2535b406-5534-4071-a5f3-406c57450206 with Priority: HIGHEST for action port [ 848.854945] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2535b406-5534-4071-a5f3-406c57450206 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.854945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2535b406-5534-4071-a5f3-406c57450206" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.854945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2535b406-5534-4071-a5f3-406c57450206" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.854945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2535b406-5534-4071-a5f3-406c57450206" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.855349] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2535b406-5534-4071-a5f3-406c57450206',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.980323] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.980569] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.980695] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.980975] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.981138] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.981297] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 48a752d4-1f8c-4c8d-a49d-5e9a22096fec not found, creating... [ 848.982344] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.982592] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.982647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.982882] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.983031] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.983335] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.983493] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.983651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.983840] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.983944] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.984095] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 48a752d4-1f8c-4c8d-a49d-5e9a22096fec is going to be created. [ 849.004040] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.004260] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.004390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.004708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.005820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.005820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.228088] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff in Status: SUCCESS [ 849.228390] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff deletion is rescheduled due to dependency. [ 849.228390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.358379] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2535b406-5534-4071-a5f3-406c57450206 [ 849.358379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.358713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.358713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.358844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.358943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.359042] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2535b406-5534-4071-a5f3-406c57450206 already deleted. [ 849.359117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2535b406-5534-4071-a5f3-406c57450206" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.810012] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-33b48793-a8bb-49c8-b31d-57a22c0c8872 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 849.810217] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-33b48793-a8bb-49c8-b31d-57a22c0c8872 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 849.810402] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-33b48793-a8bb-49c8-b31d-57a22c0c8872 service nova] Enqueued Resource ID: 48a752d4-1f8c-4c8d-a49d-5e9a22096fec with Priority: HIGHEST for action port [ 849.810915] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 849.811197] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 849.811358] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a752d4-1f8c-4c8d-a49d-5e9a22096fec with Priority: HIGHEST for action port [ 849.811787] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.811931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.811999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.812248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.812358] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.813381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.813457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.813670] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.813896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.813966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.814162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.814237] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a752d4-1f8c-4c8d-a49d-5e9a22096fec',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.917037] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e0ccf6d2-d27d-4f85-8786-f6d4f5c48ebf tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 849.917282] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 849.917509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.917628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.917693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.917945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.918282] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.013921] env[65222]: INFO networking_nsxv3.common.synchronization [None req-6ece30b6-cc0e-4c54-a205-8dc9ee1e3aa8 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 850.013921] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 850.013921] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.013921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.317733] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.318071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.318156] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a752d4-1f8c-4c8d-a49d-5e9a22096fec with status ACTIVE [ 850.318353] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.318614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.318614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.318733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.318814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.318972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.319071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.319133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.319293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.319425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.319613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.319757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.319757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.319926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.319975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.320063] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a752d4-1f8c-4c8d-a49d-5e9a22096fec is going to be updated. [ 850.347696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.347855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.347920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.348149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.348381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.348558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a752d4-1f8c-4c8d-a49d-5e9a22096fec" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.459243] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.459524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.459524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.459685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.459749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.460489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 already deleted. [ 850.460489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.460489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.460489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.460489] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.688935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 850.689783] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a deletion is rescheduled due to dependency. [ 850.689783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.689783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.689783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.689783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.690096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.690096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.690173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.690267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.690364] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.985139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.985285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.985358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.985610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.985733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.985835] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 already deleted. [ 850.986024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.010468] env[65222]: INFO networking_nsxv3.common.synchronization [None req-02aabb2e-1f5b-439d-b183-89beff4257b2 None None] Enqueued Resource ID: 70126a39-3467-4d01-96b7-fd80f0c76cc3 with Priority: HIGHEST for action port [ 851.011322] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70126a39-3467-4d01-96b7-fd80f0c76cc3 with Priority: HIGHEST for action port [ 851.011322] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-70126a39-3467-4d01-96b7-fd80f0c76cc3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.011434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70126a39-3467-4d01-96b7-fd80f0c76cc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.011477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70126a39-3467-4d01-96b7-fd80f0c76cc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.011893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70126a39-3467-4d01-96b7-fd80f0c76cc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.011985] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70126a39-3467-4d01-96b7-fd80f0c76cc3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.193217] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.514255] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70126a39-3467-4d01-96b7-fd80f0c76cc3 [ 851.514527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.514607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.514709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.514900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.515023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.515098] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70126a39-3467-4d01-96b7-fd80f0c76cc3 already deleted. [ 851.515179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70126a39-3467-4d01-96b7-fd80f0c76cc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.698397] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.200699] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.200916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.200987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.201296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.201390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.201493] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 852.234961] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.235182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.235231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.235476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.235668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.245430] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 854.258364] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 854.258823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.258823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.260102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.260102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.260102] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.766224] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.766393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.766512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.766955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.767227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.767409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.767502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.767683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.767815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.767853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.767999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.768149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.768181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.768316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.768456] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.768547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.768604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.768740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.768815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.768900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.768987] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.271391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaddab6-0327-438e-a968-548042cf4e7a: rpc.has_security_group_logging(os_id): False [ 855.292808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.292965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.293050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.293262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.293351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.293581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.293682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.293747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.293901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.293977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.294169] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.294261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.294325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.294462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.294535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.294710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.294801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.294860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.294994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.295077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.295161] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 855.357975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.358253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.358253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.358427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.358572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.371205] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 856.012335] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 856.012440] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 857.401649] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 857.401952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.996247] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-bf233532-72a4-4a6b-a4e4-065b008ca47f tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 858.997339] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 858.998079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.998470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.998753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.999240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.999642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.999980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.000258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.002126] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.363774] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.364202] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.364352] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.364656] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.364952] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.365306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.365306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.365481] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.365638] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.365794] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.365924] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.366179] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.366179] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.366289] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.366840] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.366840] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.389612] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.389788] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 859.390064] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.390588] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-26" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.390936] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-93adb960-c969-476f-ad17-798a9361a0a0 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.391774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.391774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.391774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.391774] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93adb960-c969-476f-ad17-798a9361a0a0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.507097] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.894786] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.896880] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 93adb960-c969-476f-ad17-798a9361a0a0 not found, creating... [ 859.896880] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.896880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.897393] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.897393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.897393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.897393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.897562] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.897771] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 93adb960-c969-476f-ad17-798a9361a0a0 is going to be created. [ 859.921022] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.921022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.921022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.921022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.921022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.921022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.009771] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.512668] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.512818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.512909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.513256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.513430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.513922] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 860.552362] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.552510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.552984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.552984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.553154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.565295] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 860.711736] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-9b18b335-4034-4111-87c6-6cb23317d927 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 860.712230] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-9b18b335-4034-4111-87c6-6cb23317d927 service nova] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 860.712230] env[65222]: INFO networking_nsxv3.common.synchronization [req-e1fbb0fa-ebeb-4d1b-96cd-6ee9a560f622 req-9b18b335-4034-4111-87c6-6cb23317d927 service nova] Enqueued Resource ID: 93adb960-c969-476f-ad17-798a9361a0a0 with Priority: HIGHEST for action port [ 860.712646] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_rules [ 860.713416] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 860.713416] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93adb960-c969-476f-ad17-798a9361a0a0 with Priority: HIGHEST for action port [ 860.713416] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.713416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.713416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.713802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.713802] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.715666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.715666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.715666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-93adb960-c969-476f-ad17-798a9361a0a0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.715666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.715666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.715666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.715666] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93adb960-c969-476f-ad17-798a9361a0a0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.216602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.216940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.222356] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93adb960-c969-476f-ad17-798a9361a0a0 with status ACTIVE [ 861.222566] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.222684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.222755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.222968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.223109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.227617] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.227617] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.227617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.227617] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93adb960-c969-476f-ad17-798a9361a0a0 is going to be updated. [ 861.251168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.251168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.251168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.251168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.251168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.251803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93adb960-c969-476f-ad17-798a9361a0a0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.600573] env[65222]: INFO networking_nsxv3.common.synchronization [req-cb7f3840-6d1f-4539-adfb-3cb62e9e3b61 req-d403d4e3-8b37-4b4a-9453-8c02e531e5bc tempest-ServerRescueTestJSON-1772520455 tempest-ServerRescueTestJSON-1772520455-project-member] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 861.601131] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGHEST for action security_group_members [ 861.601754] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.601754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.601903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.602077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.602230] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.602322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.602397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.602553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.602630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.602730] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.879630] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-5cc49d65-2355-472e-98f8-19539331345d tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 861.879732] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 861.880055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.880197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.880266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.880552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.880747] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.880852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.880912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.881697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.881808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.881966] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.105203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.105413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.105487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.105708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.105805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.106027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.106128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.106190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.106346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.106421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.106511] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be updated. [ 862.137885] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.138115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.138115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.138631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.138631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.148240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: IN_PROGRESS for 2s [ 862.384656] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.385096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.385096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.385251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.385636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.385636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.385862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.385862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.385967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.386273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.386273] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f already deleted. [ 862.386273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.388600] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.388600] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.388812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.389081] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.389487] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.389682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.389825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.390122] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.390349] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.390653] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.390771] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.390876] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.391009] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.391166] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.391338] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.391471] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.416374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.416600] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.416727] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.416987] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.417455] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-69629718-03f3-4521-9b58-c76a0c27eda1 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.417722] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.417911] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.418378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.418577] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69629718-03f3-4521-9b58-c76a0c27eda1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.578164] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 862.578415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.578606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.578837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.579026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.579149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.579215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.579367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.579451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.579549] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.921485] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.921776] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.921905] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.922228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.922380] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.922534] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 69629718-03f3-4521-9b58-c76a0c27eda1 not found, creating... [ 862.922809] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.922960] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.923243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.923361] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.923440] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.923790] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.923951] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.924090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.924298] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.924430] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.924564] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 69629718-03f3-4521-9b58-c76a0c27eda1 is going to be created. [ 862.946774] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.947026] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.947156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.947428] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.947661] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.947883] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.083600] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.588434] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.693219] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-efa6e1cf-93bd-48f0-8bef-d5d89bbb5159 service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 863.693417] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-efa6e1cf-93bd-48f0-8bef-d5d89bbb5159 service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 863.693555] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-efa6e1cf-93bd-48f0-8bef-d5d89bbb5159 service nova] Enqueued Resource ID: 69629718-03f3-4521-9b58-c76a0c27eda1 with Priority: HIGHEST for action port [ 863.694068] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 863.694200] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 863.694295] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69629718-03f3-4521-9b58-c76a0c27eda1 with Priority: HIGHEST for action port [ 863.694563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.694676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.694770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.695038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.695126] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.696434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.696597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.696663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.696857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.696952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.697101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.697101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.697241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.697325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.697464] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.698461] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-69629718-03f3-4521-9b58-c76a0c27eda1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.698461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.698461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.698612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.698612] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69629718-03f3-4521-9b58-c76a0c27eda1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.092030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.092177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.092226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.092499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.092692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.092782] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 864.124673] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.124893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.124893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.125450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.125651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.141689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 864.157695] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c338b2c-c780-410a-aac2-962f91390b3f in Status: SUCCESS [ 864.157886] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f deletion is rescheduled due to dependency. [ 864.158078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.197757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.197974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.201492] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.204670] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69629718-03f3-4521-9b58-c76a0c27eda1 with status ACTIVE [ 864.204901] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.205265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.205265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.205483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.205483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.205646] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.205743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.206022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.206022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.206176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206230] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.206327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.206386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.206530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.206605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.206719] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69629718-03f3-4521-9b58-c76a0c27eda1 is going to be updated. [ 864.231856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.232153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.232153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.232398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.232751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.232959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69629718-03f3-4521-9b58-c76a0c27eda1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.704969] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.210064] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.210064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.210064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.210064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.210064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.210064] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be created. [ 865.242683] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.242683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.242683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.242936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.243071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.255388] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: UNINITIALIZED for 2s [ 865.271388] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-497242ca-2505-4fc7-9396-0f43a51e19d5 tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 865.272034] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 865.272551] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.272710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.706036] env[65222]: INFO networking_nsxv3.common.synchronization [req-38752e8c-b344-4a8d-8cf6-cdcab8441682 req-36657c14-9fcf-48d4-8a92-9c8bfddea3c3 tempest-ServersTestBootFromVolume-1606057182 tempest-ServersTestBootFromVolume-1606057182-project-member] Enqueued Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 865.706822] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db with Priority: HIGHEST for action security_group_members [ 865.708024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.708024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.708024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.708450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.708450] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fbc24f1-8254-4b9b-9b11-d6605f74d8db',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.080018] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.080234] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.080412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.080703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.080964] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.081132] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.081247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.081656] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.081823] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.082101] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.082228] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.082366] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.082440] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.082554] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.082665] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.082818] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.102268] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.102513] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.102695] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.102943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.103282] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.103455] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.103574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.103882] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.104069] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.153244] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.153244] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.153244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.154529] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.211614] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.211614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.211614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.211614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.239615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.240199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.240625] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.240810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.241108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.242983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.242983] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db is going to be updated. [ 866.273289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.273289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.273289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.273289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.273289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.303337] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: IN_PROGRESS for 2s [ 866.606989] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.607819] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.607976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.609230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.609230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.609230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d not found, creating... [ 866.609230] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.609523] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.609717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.609865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.610051] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.610412] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.611814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.611814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.611814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.611814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.611814] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d is going to be created. [ 866.632517] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.632616] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.632652] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.633289] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.634292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.634486] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.656408] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.656779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.656779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.656951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.656997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.657111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.657175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.657325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.657413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.657501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.657647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.657737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.657799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.657929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.658075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.658176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.658220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.658902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.658902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.658902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.658902] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.161040] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaddab6-0327-438e-a968-548042cf4e7a: rpc.has_security_group_logging(os_id): False [ 867.180524] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.180524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.180524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.180922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.180922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.181689] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.181689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.181689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.181689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.181689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.181689] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.182446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.182446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.182446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.182446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.182446] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.182446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.182644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.182644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.183055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.183055] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 867.249148] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.249148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.249148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.249148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.249404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.263365] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 867.264685] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 867.264906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.265375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.267703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.267914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.268055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.268123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.268272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.268363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.268564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.268564] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.269729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.269729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.269916] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.269916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.270064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.270149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.270224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.270311] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.379252] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-51f6ed5e-f0dd-46c5-8ba6-5c7015515e1d service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 867.379252] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-51f6ed5e-f0dd-46c5-8ba6-5c7015515e1d service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 867.379252] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-51f6ed5e-f0dd-46c5-8ba6-5c7015515e1d service nova] Enqueued Resource ID: 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d with Priority: HIGHEST for action port [ 867.379924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 867.379924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 867.379924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d with Priority: HIGHEST for action port [ 867.380630] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.380852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.381024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.381163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.383025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.383025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.383025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.383025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.383025] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.774672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.774851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.775061] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.887465] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d with status ACTIVE [ 867.887725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.887859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.887930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.890157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.892677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.892677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.892677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.892677] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d is going to be updated. [ 867.938325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.938325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.938325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.938325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.938325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.938325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f7b2a8-687f-4dfb-bcde-df7bfa7d4f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.194955] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-b95b27d4-27fb-44b7-86c2-d5d5abf8214d tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 868.196092] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 868.196466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.196809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.278569] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.314839] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db in Status: SUCCESS [ 868.315478] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fbc24f1-8254-4b9b-9b11-d6605f74d8db deletion is rescheduled due to dependency. [ 868.315478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fbc24f1-8254-4b9b-9b11-d6605f74d8db" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.781651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.781872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.781971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.782371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.782564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.782820] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 868.855172] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.855172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.855172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.855974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.855974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.865628] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.865985] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.866516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.866953] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.867487] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.867773] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.868010] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.868434] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.868726] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.869110] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.869243] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.869370] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.869482] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.869595] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.869713] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.869850] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.871684] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 868.904269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.904269] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.904269] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.904269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-913" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.904269] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-98a6e675-37cc-4de2-97e0-82164155e98e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.904269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.904269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.904269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.904269] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98a6e675-37cc-4de2-97e0-82164155e98e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.291763] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 869.292125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.409890] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.410144] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.410271] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.410624] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.410786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.410944] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 98a6e675-37cc-4de2-97e0-82164155e98e not found, creating... [ 869.411554] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.411554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.411554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.411790] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.411841] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.412513] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.412513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.412513] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.412781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.412781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.412902] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 98a6e675-37cc-4de2-97e0-82164155e98e is going to be created. [ 869.434355] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434675] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.435158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.435158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.435394] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.137522] env[65222]: INFO networking_nsxv3.common.synchronization [req-d2339162-f8ad-4a51-9b7e-fd531bb6ce9a req-5f03cabc-a296-4fab-80d1-dfe2006164f7 tempest-InstanceActionsV221TestJSON-1500077314 tempest-InstanceActionsV221TestJSON-1500077314-project-member] Enqueued Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 870.138850] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 870.140982] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-75f2166c-0b91-45a3-a1bb-5f4f5abace15 service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 870.141254] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-75f2166c-0b91-45a3-a1bb-5f4f5abace15 service nova] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 870.141587] env[65222]: INFO networking_nsxv3.common.synchronization [req-1efa6444-8cb0-4595-8a5a-29ddd4b051b5 req-75f2166c-0b91-45a3-a1bb-5f4f5abace15 service nova] Enqueued Resource ID: 98a6e675-37cc-4de2-97e0-82164155e98e with Priority: HIGHEST for action port [ 870.142012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.142197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.142298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.142633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.142845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.143232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.143232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.143232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.143672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.143672] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.144871] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_rules [ 870.145567] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 870.146459] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a6e675-37cc-4de2-97e0-82164155e98e with Priority: HIGHEST for action port [ 870.149405] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.149509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.149718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.149823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.149990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-98a6e675-37cc-4de2-97e0-82164155e98e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.150229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.150229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.150547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.150547] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98a6e675-37cc-4de2-97e0-82164155e98e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.656045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.656045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.656045] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 already deleted. [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.656045] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98a6e675-37cc-4de2-97e0-82164155e98e with status ACTIVE [ 870.656045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.656045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.657069] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.657069] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.657069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.657069] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98a6e675-37cc-4de2-97e0-82164155e98e is going to be updated. [ 870.683365] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.683365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.683365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.683365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.683365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.683365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98a6e675-37cc-4de2-97e0-82164155e98e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.816898] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.817104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-291" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.817233] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-291" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.817796] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-291" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.817888] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.818151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.818289] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.818580] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.818840] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.818971] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.819135] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.819255] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.819367] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.819479] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.819588] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.819784] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.841274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.841515] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.841578] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.841739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-291" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.842072] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-05f3fc2b-9782-4515-8653-9521c58004f0 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.842244] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.842386] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.842741] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.842881] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f3fc2b-9782-4515-8653-9521c58004f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.897714] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 870.898193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.898331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.898749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.899090] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.899250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.899315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.899501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.900465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.900465] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.345498] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.345841] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.345982] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.346290] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.346443] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.346602] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 05f3fc2b-9782-4515-8653-9521c58004f0 not found, creating... [ 871.346854] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.347017] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.347136] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.347354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.347485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.347763] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.347910] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.348032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.348235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.348466] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.348620] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 05f3fc2b-9782-4515-8653-9521c58004f0 is going to be created. [ 871.368355] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.368614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.368742] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.368974] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.369214] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.369436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.403208] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.906203] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.091262] env[65222]: INFO networking_nsxv3.common.synchronization [req-d2339162-f8ad-4a51-9b7e-fd531bb6ce9a req-42b0b007-6da5-44ec-bf34-abaa72ee5979 service nova] Enqueued Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_rules [ 872.091528] env[65222]: INFO networking_nsxv3.common.synchronization [req-d2339162-f8ad-4a51-9b7e-fd531bb6ce9a req-42b0b007-6da5-44ec-bf34-abaa72ee5979 service nova] Enqueued Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 872.091705] env[65222]: INFO networking_nsxv3.common.synchronization [req-d2339162-f8ad-4a51-9b7e-fd531bb6ce9a req-42b0b007-6da5-44ec-bf34-abaa72ee5979 service nova] Enqueued Resource ID: 05f3fc2b-9782-4515-8653-9521c58004f0 with Priority: HIGHEST for action port [ 872.092295] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_rules [ 872.092433] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 872.092529] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f3fc2b-9782-4515-8653-9521c58004f0 with Priority: HIGHEST for action port [ 872.092827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.092949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.093048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.093288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.093360] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.095186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.095331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.095432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.095621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.096503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.096629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.096718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.096895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.096991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.097124] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.097999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f3fc2b-9782-4515-8653-9521c58004f0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.098431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.098509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.098680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.098904] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f3fc2b-9782-4515-8653-9521c58004f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.344748] env[65222]: INFO networking_nsxv3.common.synchronization [None req-92fc0db5-6753-4123-aca8-0e2f5c474ce1 None None] Enqueued Resource ID: e1a7376c-b486-43b9-ab90-3661fea313ce with Priority: HIGHEST for action port [ 872.345351] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a7376c-b486-43b9-ab90-3661fea313ce with Priority: HIGHEST for action port [ 872.346112] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a7376c-b486-43b9-ab90-3661fea313ce taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.346813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a7376c-b486-43b9-ab90-3661fea313ce" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.346813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a7376c-b486-43b9-ab90-3661fea313ce" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.346813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a7376c-b486-43b9-ab90-3661fea313ce" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.346813] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a7376c-b486-43b9-ab90-3661fea313ce',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.408556] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.408749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.408844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.409078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.409154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.409853] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 872.446255] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.446504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.446504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.446677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.446820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.472022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 872.600679] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.601880] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.602040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.602256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05f3fc2b-9782-4515-8653-9521c58004f0 with status ACTIVE [ 872.602449] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.602650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.602722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.602944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.603073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.603326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.603447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.603516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.603723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.603816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.604039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.604150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.604233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.604394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.604471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.604576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05f3fc2b-9782-4515-8653-9521c58004f0 is going to be updated. [ 872.629832] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.630135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.630135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.630315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.630393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.630863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f3fc2b-9782-4515-8653-9521c58004f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.849748] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1a7376c-b486-43b9-ab90-3661fea313ce [ 872.850048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.850448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.850448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.850601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.850641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.850726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1a7376c-b486-43b9-ab90-3661fea313ce already deleted. [ 872.850806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a7376c-b486-43b9-ab90-3661fea313ce" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.906672] env[65222]: INFO networking_nsxv3.common.synchronization [req-f93bcc68-b61c-482c-bb83-8fb46a415205 req-9fb38d46-7216-4f3a-9cc4-612b60d6e304 tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 872.907234] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 872.907530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.907654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.907723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.907924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.908264] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.908407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.908513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.908708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.909618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.909794] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.107596] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.291298] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.291505] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.291641] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.291913] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.292182] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.292363] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.292483] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.292701] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.292851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.293136] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.293259] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.293370] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.293476] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.293586] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.293688] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.293823] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.314579] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.314779] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.314880] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.315023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-944" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.315350] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.315524] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.315644] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.316019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.316158] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b224bf3b-e615-4c56-bff8-5b9f727d1e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.412143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.412459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.412459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.412752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.437615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.437935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.438072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.438072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.438364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.438449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.438849] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be updated. [ 873.477113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.477260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.477423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.477611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.477838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.490012] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 873.609661] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.609928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.609928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.610192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.610279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.610385] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 is going to be created. [ 873.637321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.637508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.637508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.637717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.637899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.651484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: UNINITIALIZED for 2s [ 873.819104] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.819333] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.819456] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.819971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.820219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.820554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b224bf3b-e615-4c56-bff8-5b9f727d1e7a not found, creating... [ 873.821155] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.821368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.821673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.822367] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.822522] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.823032] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.823212] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.823332] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.823566] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.823721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.824036] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b224bf3b-e615-4c56-bff8-5b9f727d1e7a is going to be created. [ 873.846532] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.846928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.847130] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.848893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.848893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.848893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.285570] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c07dda08-3def-454c-be51-6b304fb10f4c None None] Enqueued Resource ID: 6f5d3f57-6549-408e-8605-5c9651a8d70e with Priority: HIGHEST for action port [ 874.286754] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f5d3f57-6549-408e-8605-5c9651a8d70e with Priority: HIGHEST for action port [ 874.287250] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f5d3f57-6549-408e-8605-5c9651a8d70e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.287741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f5d3f57-6549-408e-8605-5c9651a8d70e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.288012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f5d3f57-6549-408e-8605-5c9651a8d70e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.288370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f5d3f57-6549-408e-8605-5c9651a8d70e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.288597] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f5d3f57-6549-408e-8605-5c9651a8d70e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.482762] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 874.482990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.483174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.483398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.483790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.483987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.483987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.484169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.484251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.484331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.484512] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.484629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.484701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.484784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.485143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.485335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.485335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.485454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.485509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.485610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.485678] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.486786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.486912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.487059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.487190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.487268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.487334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.487438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.487491] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.582068] env[65222]: INFO networking_nsxv3.common.synchronization [req-f93bcc68-b61c-482c-bb83-8fb46a415205 req-3f50f5f7-ea01-4330-a428-fe4252495452 service nova] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 874.582368] env[65222]: INFO networking_nsxv3.common.synchronization [req-f93bcc68-b61c-482c-bb83-8fb46a415205 req-3f50f5f7-ea01-4330-a428-fe4252495452 service nova] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 874.582615] env[65222]: INFO networking_nsxv3.common.synchronization [req-f93bcc68-b61c-482c-bb83-8fb46a415205 req-3f50f5f7-ea01-4330-a428-fe4252495452 service nova] Enqueued Resource ID: b224bf3b-e615-4c56-bff8-5b9f727d1e7a with Priority: HIGHEST for action port [ 874.583477] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_rules [ 874.583832] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 874.584193] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b224bf3b-e615-4c56-bff8-5b9f727d1e7a with Priority: HIGHEST for action port [ 874.584573] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.584867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.584967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.585334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.585528] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.586814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.587043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.587543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.587644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.587805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.588148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.588323] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b224bf3b-e615-4c56-bff8-5b9f727d1e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.793608] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f5d3f57-6549-408e-8605-5c9651a8d70e [ 874.793608] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.793608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.793608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.793608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.793608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.793608] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f5d3f57-6549-408e-8605-5c9651a8d70e already deleted. [ 874.793871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f5d3f57-6549-408e-8605-5c9651a8d70e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.989457] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c156d898-0c95-428d-be52-aca57ef2133f: rpc.has_security_group_logging(os_id): False [ 874.990868] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.023024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.023024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.023024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.023024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.023686] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.023686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.023686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.023686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.023686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.024303] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be created. [ 875.052858] env[65222]: INFO networking_nsxv3.common.synchronization [None req-71936f0a-3d00-457e-b677-6a5c0c023098 None None] Enqueued Resource ID: 2fa03a31-8a54-45d4-b98d-087e1c8c91c7 with Priority: HIGHEST for action port [ 875.053714] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa03a31-8a54-45d4-b98d-087e1c8c91c7 with Priority: HIGHEST for action port [ 875.053714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa03a31-8a54-45d4-b98d-087e1c8c91c7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.053886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa03a31-8a54-45d4-b98d-087e1c8c91c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.053928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa03a31-8a54-45d4-b98d-087e1c8c91c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.054655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa03a31-8a54-45d4-b98d-087e1c8c91c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.054655] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa03a31-8a54-45d4-b98d-087e1c8c91c7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.090647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.090844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.091344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.091344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.091344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.092846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.092974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.093185] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b224bf3b-e615-4c56-bff8-5b9f727d1e7a with status ACTIVE [ 875.093477] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.093590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.093658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.093833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.093917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.094100] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.094196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.094258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.094422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.094513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.094695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.094789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.094841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.095092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.095092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.095205] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b224bf3b-e615-4c56-bff8-5b9f727d1e7a is going to be updated. [ 875.109631] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 875.122632] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.123325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.123325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.123325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.123486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.123730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b224bf3b-e615-4c56-bff8-5b9f727d1e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.171900] env[65222]: INFO networking_nsxv3.common.synchronization [req-1cbfaa28-a644-41eb-b7b6-f91d9c0e47ed req-269ac25d-a8ab-4cf7-909b-e1fdde2075f2 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 875.171900] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 875.175601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.175601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.175601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.175601] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.494330] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.502130] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 875.503751] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 deletion is rescheduled due to dependency. [ 875.503880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.504900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.506200] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.506200] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.559669] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fa03a31-8a54-45d4-b98d-087e1c8c91c7 [ 875.559669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.559669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.559669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.559669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.559669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.559669] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fa03a31-8a54-45d4-b98d-087e1c8c91c7 already deleted. [ 875.559669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa03a31-8a54-45d4-b98d-087e1c8c91c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.663886] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: SUCCESS [ 875.664904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.664904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.664996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.665228] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.665362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.665658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.665658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.665844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.665844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.665914] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.678121] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.720622] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.720622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.720622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.720622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.721575] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.721808] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.722139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.722285] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.722432] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.722653] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.722774] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.722968] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.723089] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.723158] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.723210] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.723362] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.756257] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.756257] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.756257] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.756257] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-737" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.756257] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.756814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.756814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.756985] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.757155] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.997393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.997725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.997725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.998034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.998202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.998417] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 876.008373] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.042717] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.042717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.042717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.043201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.043201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.072539] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 876.172287] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.172714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.172859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.173116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.173307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.173745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.173884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.174075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.174167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.174261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.174956] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.175094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.175133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.175283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.175663] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.175663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.175663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.175822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.175822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.175887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.175951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.179246] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.261886] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.262051] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.262154] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.262498] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.262701] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.262950] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 not found, creating... [ 876.263340] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.263579] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.263935] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.264924] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.265292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.265636] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.265953] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.265953] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.266173] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.266349] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.266501] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 is going to be created. [ 876.305047] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.305360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.305505] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.305782] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.306023] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.306269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.468854] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a4e28f3e-524d-4b18-a382-7baf17e5fc26 None None] Enqueued Resource ID: e66b29b9-7ec0-49ef-9bb1-42e0414fbe98 with Priority: HIGHEST for action port [ 876.469446] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66b29b9-7ec0-49ef-9bb1-42e0414fbe98 with Priority: HIGHEST for action port [ 876.469750] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e66b29b9-7ec0-49ef-9bb1-42e0414fbe98 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.469889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e66b29b9-7ec0-49ef-9bb1-42e0414fbe98" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.469943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e66b29b9-7ec0-49ef-9bb1-42e0414fbe98" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.470845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e66b29b9-7ec0-49ef-9bb1-42e0414fbe98" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.470979] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66b29b9-7ec0-49ef-9bb1-42e0414fbe98',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.514085] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.679084] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaf2c545-8660-4507-8e07-7248fbb414a5: rpc.has_security_group_logging(os_id): False [ 876.682331] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.682520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.682590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.682813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.682914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.683012] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 876.703199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.703399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.703453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.703653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.703749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.703975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.704103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.704171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.704335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.704414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.704660] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.704791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.704860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.705143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.705270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.705592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.705739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.705830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.706018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.706132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.706256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 is going to be created. [ 876.725020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.725020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.725020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.725020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.725020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.737087] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 876.785985] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.786164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.786231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.786433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.787344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.811866] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: IN_PROGRESS for 2s [ 876.974306] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e66b29b9-7ec0-49ef-9bb1-42e0414fbe98 [ 876.974668] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.974849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.975629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.975629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.975629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.975629] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e66b29b9-7ec0-49ef-9bb1-42e0414fbe98 already deleted. [ 876.980583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e66b29b9-7ec0-49ef-9bb1-42e0414fbe98" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.020256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.020440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.020543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.020828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.020978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.021140] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be updated. [ 877.026090] env[65222]: INFO networking_nsxv3.common.synchronization [req-1cbfaa28-a644-41eb-b7b6-f91d9c0e47ed req-4028341b-a37e-479c-8edb-eccd94a37f69 service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 877.027785] env[65222]: INFO networking_nsxv3.common.synchronization [req-1cbfaa28-a644-41eb-b7b6-f91d9c0e47ed req-4028341b-a37e-479c-8edb-eccd94a37f69 service nova] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 877.027785] env[65222]: INFO networking_nsxv3.common.synchronization [req-1cbfaa28-a644-41eb-b7b6-f91d9c0e47ed req-4028341b-a37e-479c-8edb-eccd94a37f69 service nova] Enqueued Resource ID: 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 with Priority: HIGHEST for action port [ 877.029450] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_rules [ 877.029677] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 877.029832] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 with Priority: HIGHEST for action port [ 877.030879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.031042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.031103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.031280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.031363] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.033288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.033438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.033602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.033869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.033989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.034174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.034341] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.066786] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.067019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.067019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.067296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.067708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.078892] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 877.127787] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 877.128012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.128200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.128422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.128508] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.534158] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.534476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.536887] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 with status ACTIVE [ 877.538743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.538743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.538743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.539190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.539736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.540592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.544259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.544259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.544259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.544259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.544259] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842 is going to be updated. [ 877.595035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.595200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.595200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.595428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.595566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.595741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eee2ee1-f1fd-4a8e-9a3a-34cf86bdf842" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.631830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.631977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.085661] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 878.086556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.086934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.087355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.087785] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.088162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.088483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.088819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.089110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.089372] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.502293] env[65222]: INFO networking_nsxv3.common.synchronization [req-cfc11fb4-2715-44fe-bbe9-b3f7eb5a5889 req-935e7570-4169-4d97-8d8b-acb8e718857b tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 878.502850] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 878.503175] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.503295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.503359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.503625] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.504400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.504400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.504400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.504400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.504400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.504400] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.597022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.746830] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 878.747154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.747335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.747624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.747823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.747943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.748021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.748181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.748296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.748511] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.827881] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: SUCCESS [ 878.827881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.007317] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.007526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.007676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.007829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.007864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.008085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.008180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.008366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.008438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.008474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.008542] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7d31cf-9989-4765-9a76-058b268adcef already deleted. [ 879.008622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.075718] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.075927] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.076062] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.076399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.076690] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.076860] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.076987] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.077281] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.077443] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.077659] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.077770] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.077876] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.077979] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.078099] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.078200] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.078329] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.089388] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 879.089547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.090032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.090237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.090429] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.090565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.090645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.090807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.090889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.090974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.091086] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.096981] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.100197] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.100361] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.100540] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.100750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.101116] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-b1f95a19-f27e-4bad-99e1-f02dc9116f07 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.101298] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.101504] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.101909] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.102086] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f95a19-f27e-4bad-99e1-f02dc9116f07',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.254348] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.594308] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.599517] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.599517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.600028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.600028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.600028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.600190] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 879.604098] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.604361] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.604579] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.604882] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.605107] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.605333] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port b1f95a19-f27e-4bad-99e1-f02dc9116f07 not found, creating... [ 879.605631] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.605835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.605993] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.606335] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.606477] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.606776] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.607034] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.607221] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.607448] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.607584] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.607727] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: b1f95a19-f27e-4bad-99e1-f02dc9116f07 is going to be created. [ 879.688206] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.688723] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.688897] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.689302] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.689694] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.690070] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.697695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.697888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.698067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.698316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.698456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.739017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 879.757472] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.096309] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44afacd5-bc37-4272-9409-ec05ce0c00f8: rpc.has_security_group_logging(os_id): False [ 880.115925] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.116089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.116153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.116648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.116648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.117267] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.117406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.117471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.117643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.117723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.117824] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be updated. [ 880.200726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.200938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.200990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.201240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.201391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.215179] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 880.259841] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.260209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.260209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.260574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.260733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.260917] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 880.340714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.340934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.341043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.341266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.341430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.363278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 880.456770] env[65222]: INFO networking_nsxv3.common.synchronization [req-cfc11fb4-2715-44fe-bbe9-b3f7eb5a5889 req-71d97c09-5729-4255-af5a-ffe303dc1887 service nova] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 880.456770] env[65222]: INFO networking_nsxv3.common.synchronization [req-cfc11fb4-2715-44fe-bbe9-b3f7eb5a5889 req-71d97c09-5729-4255-af5a-ffe303dc1887 service nova] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 880.456770] env[65222]: INFO networking_nsxv3.common.synchronization [req-cfc11fb4-2715-44fe-bbe9-b3f7eb5a5889 req-71d97c09-5729-4255-af5a-ffe303dc1887 service nova] Enqueued Resource ID: b1f95a19-f27e-4bad-99e1-f02dc9116f07 with Priority: HIGHEST for action port [ 880.457183] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_rules [ 880.457366] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 880.457976] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f95a19-f27e-4bad-99e1-f02dc9116f07 with Priority: HIGHEST for action port [ 880.457976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.458181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.458181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.458508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.458586] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.460572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.460572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.460572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.460751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.460851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.460909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.460969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.461155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.461280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.461536] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.463116] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f95a19-f27e-4bad-99e1-f02dc9116f07 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.463266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.463312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.463312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.463621] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f95a19-f27e-4bad-99e1-f02dc9116f07',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.755672] env[65222]: INFO networking_nsxv3.common.synchronization [req-e5ac9acb-c4ac-480b-98f0-dae4a5bf5501 req-756c1fda-bc2a-4054-a87b-da8c3f78f47f tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 880.756647] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 880.756878] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.757102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.757244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.757562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.757824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.758015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.758149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.758440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.758603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.758767] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.961963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.962095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.963586] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.966314] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f95a19-f27e-4bad-99e1-f02dc9116f07 with status ACTIVE [ 880.966538] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.966632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.966703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.966929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.967064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.967823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.967951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.968032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.968220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.968305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.968612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.968807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.968807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.968902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.968957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.969052] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f95a19-f27e-4bad-99e1-f02dc9116f07 is going to be updated. [ 881.002518] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.002790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.002935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.003300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.003525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.004176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f95a19-f27e-4bad-99e1-f02dc9116f07" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.262479] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.262479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.264156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.265266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.265266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.265266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.265266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.265266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.268955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.268955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.269095] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 881.310933] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.311203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.311203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.311466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.311652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.322014] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 881.465761] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.753898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.753898] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.753898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.753898] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.968522] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.969845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.972188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.972188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.972188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.972188] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7d31cf-9989-4765-9a76-058b268adcef is going to be created. [ 882.003772] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.015507] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: UNINITIALIZED for 2s [ 882.233554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 882.233554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.291032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.291032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.291032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.291032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.291032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.294355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.294355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.294355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.294355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.294355] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.376410] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 882.376410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.376716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.377047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.377301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.377420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.377527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.377704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.377831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.377924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.378094] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.772802] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c156d898-0c95-428d-be52-aca57ef2133f: rpc.has_security_group_logging(os_id): False [ 882.799022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.799022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.799022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.799372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.799372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.799596] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.799681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.799718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.800114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.800114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.800343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.800343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.800343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.800656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.800656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.800843] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.801599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.801695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.802286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.802373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.802466] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 882.882293] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.882427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.882601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.882776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.882884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.883053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.883095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.883440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.883620] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.883737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.883779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.884126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.884275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.884340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.884486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.884585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884753] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.899039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.899039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.899039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.899039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.899567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.932765] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 883.334645] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 883.334941] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 883.335218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.392306] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934c2ee4-8fd3-4a49-b822-071d800eb172: rpc.has_security_group_logging(os_id): False [ 883.409998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.410206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.410206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.410425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.410577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.410784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.411227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.411227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.411227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.411227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.411395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.411498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.411498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.412338] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.412338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.412707] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 883.485681] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.485811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.485909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.486119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.486270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.499747] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 884.028408] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: SUCCESS [ 884.028740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.028986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.029232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.029428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.029584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.029647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.029949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.030077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.030172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.030279] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.533818] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.953062] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 884.953470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.953852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.953957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.954035] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.037675] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7d31cf-9989-4765-9a76-058b268adcef: rpc.has_security_group_logging(os_id): False [ 885.065831] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.065831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.065831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.065998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.065998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.066871] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.066871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.066871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.066871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.066871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.066871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7d31cf-9989-4765-9a76-058b268adcef is going to be created. [ 885.164719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.164719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.164719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.164719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.164957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.184242] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: IN_PROGRESS for 2s [ 885.456782] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.456951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.457039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.457363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.457549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.457660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.457726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.457876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.457968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.458832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.458832] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.516694] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 885.516694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.757835] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 885.758153] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 885.960965] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.961157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.961232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.961453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.961761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.961761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.961840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.961966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.962069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.962157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.962307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.962414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.962477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.962619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.962759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.962895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.962967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.963124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.963222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.963278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.963370] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.468210] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c156d898-0c95-428d-be52-aca57ef2133f: rpc.has_security_group_logging(os_id): False [ 886.502223] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.502402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.502402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.503040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.503040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.503199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.503402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.503402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.503614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.503706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.503937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.504106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.504220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.504712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.504712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.504820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.504912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.504973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.505179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.505308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.505426] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 886.588034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.588401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.589014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.589014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.589014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.616891] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 887.199996] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: SUCCESS [ 887.200696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.411548] env[65222]: INFO networking_nsxv3.common.synchronization [req-6cc5ca86-a501-4244-918d-e09a470d747d req-13eb56d6-bc2d-4bdf-8fd5-ae219e20fb0d tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 887.412826] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 887.413010] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.413274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.413344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.413561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.413839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.413947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.414158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.414588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.414701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.414802] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.861298] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.861674] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.861894] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.862319] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.862682] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.862933] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.863137] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.863427] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.863621] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.863910] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.864085] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.864256] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.864441] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.864599] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.864714] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.864895] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.886347] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.886538] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.886689] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.886872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.887325] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-b35bf277-74bd-41b6-b804-eb85354f7b6c taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.887626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.887841] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.888483] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.888615] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b35bf277-74bd-41b6-b804-eb85354f7b6c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.918582] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.008556] env[65222]: INFO networking_nsxv3.common.synchronization [req-36f15e92-ee5c-4ace-9fa5-41d461d70e6d req-63b5f548-a52a-49fe-bc8e-c18cab547835 tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 888.009987] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 888.009987] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.009987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.009987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.009987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.010286] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.010729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.012777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.012777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.012777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.012777] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.391498] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.391954] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.392101] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.392411] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.392570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.392734] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port b35bf277-74bd-41b6-b804-eb85354f7b6c not found, creating... [ 888.393060] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.393242] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.393547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.393615] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.393752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.394076] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.394295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.394430] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.394651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.394792] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.394931] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: b35bf277-74bd-41b6-b804-eb85354f7b6c is going to be created. [ 888.421351] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.423791] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.424702] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.424702] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.424702] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.424837] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.425081] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.519078] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.633622] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 888.633773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.928779] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.928891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.928963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.929210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.929296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.929396] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 889.012812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.012812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.012812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.012812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.016962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.022505] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.037461] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 889.209807] env[65222]: INFO networking_nsxv3.common.synchronization [req-6cc5ca86-a501-4244-918d-e09a470d747d req-7cc74eae-fb9a-456d-900b-23f41ededbf3 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 889.210805] env[65222]: INFO networking_nsxv3.common.synchronization [req-6cc5ca86-a501-4244-918d-e09a470d747d req-7cc74eae-fb9a-456d-900b-23f41ededbf3 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 889.211268] env[65222]: INFO networking_nsxv3.common.synchronization [req-6cc5ca86-a501-4244-918d-e09a470d747d req-7cc74eae-fb9a-456d-900b-23f41ededbf3 service nova] Enqueued Resource ID: b35bf277-74bd-41b6-b804-eb85354f7b6c with Priority: HIGHEST for action port [ 889.212278] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 889.212509] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 889.212759] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b35bf277-74bd-41b6-b804-eb85354f7b6c with Priority: HIGHEST for action port [ 889.213187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.215114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.215114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.215114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.215114] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.215601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.215702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.219474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b35bf277-74bd-41b6-b804-eb85354f7b6c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.219606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.219678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.219932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.220083] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b35bf277-74bd-41b6-b804-eb85354f7b6c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.515029] env[65222]: INFO networking_nsxv3.common.synchronization [req-6baafb1b-894c-4f10-b907-57be08c6888c req-fd30153f-d025-4ab5-bed0-7106d82c59d8 tempest-MultipleCreateTestJSON-2054322131 tempest-MultipleCreateTestJSON-2054322131-project-member] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 889.515998] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGHEST for action security_group_members [ 889.515998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.515998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.526430] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.526430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.526430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.526430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.526430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.526430] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 889.557207] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.557489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.557489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.557620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.557814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.570532] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 889.721861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.722026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.723358] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b35bf277-74bd-41b6-b804-eb85354f7b6c with status ACTIVE [ 889.723616] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.723762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.723845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.724091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.724210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.724405] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.724733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.724733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.724902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.724991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.725253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.725386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.725603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.725775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.725886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.725999] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b35bf277-74bd-41b6-b804-eb85354f7b6c is going to be updated. [ 889.757570] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.757849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.757933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.759706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.759706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.759706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b35bf277-74bd-41b6-b804-eb85354f7b6c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.362122] env[65222]: INFO networking_nsxv3.common.synchronization [req-df78c31a-74a3-4b8b-a310-3a24cfc4eb2a req-c7967cbf-ee93-440e-91e4-a8ebdcb009a9 tempest-InstanceActionsV221TestJSON-1500077314 tempest-InstanceActionsV221TestJSON-1500077314-project-member] Enqueued Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 890.363820] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGHEST for action security_group_members [ 890.363820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.363820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.363820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.363820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.364374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.364374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.364374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.364551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.364880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.364880] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.867378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.867785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.867785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.867905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.867951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.868245] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.868245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.868384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.868477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.868554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.868646] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 is going to be updated. [ 890.907458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.907690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.907690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.907882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.908993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.920425] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: IN_PROGRESS for 2s [ 891.053167] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 891.054673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.054792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.055078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.055327] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.055466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.056637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.056637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.056637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.056637] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.559013] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.585486] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 891.585703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.585888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.587073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.587073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.587073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.587073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.587073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.587073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.587073] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.605196] env[65222]: INFO networking_nsxv3.common.synchronization [req-a50a51d2-532e-4d47-bcb9-9c16b1c3d7ab req-fad29b23-d24d-451d-8bce-5ebfee3744ae tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 891.606500] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 891.606988] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.607169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.607259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.607603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.607814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.608171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.608171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.608258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.608342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.608506] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.994952] env[65222]: INFO networking_nsxv3.common.synchronization [req-94955ce0-b8de-4b48-944b-273d904ae7f6 req-3030c852-3438-491a-a9f3-375b761a32dc tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 891.995746] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 892.002795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.002795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.002795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.002795] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.063583] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.089653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.089809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.089881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.090119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.090210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.090487] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.090564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.090660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.090844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.090924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.091024] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be updated. [ 892.111235] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.111454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.111454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.111751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.111808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.111975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.112100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.112147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.112308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.112381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.112470] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 already deleted. [ 892.112655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.115238] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.115457] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.115574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.115943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.116226] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.116387] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.116575] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.116845] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.117066] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.117503] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.117740] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.117967] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.118451] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.118667] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.118850] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.118996] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.131416] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.131575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.131660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.132145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.132276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.146044] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.146266] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.146418] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.146591] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.146932] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-7357c39f-354f-4b15-be5d-10792ddb5c54 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.147209] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.147338] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.148922] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.149079] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7357c39f-354f-4b15-be5d-10792ddb5c54',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.151668] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: IN_PROGRESS for 2s [ 892.506277] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.568544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.568833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.568931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.569257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.569375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.569514] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 892.622967] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.622967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.622967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.622967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.622967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.634906] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 892.653436] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.653436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.653436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.653920] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.654760] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.654760] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 7357c39f-354f-4b15-be5d-10792ddb5c54 not found, creating... [ 892.654915] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.655175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.655390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.655722] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.655948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.656482] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.656750] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.656917] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.657295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.657536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.657766] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 7357c39f-354f-4b15-be5d-10792ddb5c54 is going to be created. [ 892.694548] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.695584] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.695763] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.696151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.696429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.696730] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.934127] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf2c545-8660-4507-8e07-7248fbb414a5 in Status: SUCCESS [ 892.936016] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 deletion is rescheduled due to dependency. [ 892.936016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.008162] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.510435] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.510735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.510735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.510964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.511090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.511169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 893.544192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.544437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.544437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.544665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.545138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.557032] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 893.907823] env[65222]: INFO networking_nsxv3.common.synchronization [req-a50a51d2-532e-4d47-bcb9-9c16b1c3d7ab req-b1b61933-d3fc-4a1b-baee-a45fb881a538 service nova] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_rules [ 893.907823] env[65222]: INFO networking_nsxv3.common.synchronization [req-a50a51d2-532e-4d47-bcb9-9c16b1c3d7ab req-b1b61933-d3fc-4a1b-baee-a45fb881a538 service nova] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 893.907823] env[65222]: INFO networking_nsxv3.common.synchronization [req-a50a51d2-532e-4d47-bcb9-9c16b1c3d7ab req-b1b61933-d3fc-4a1b-baee-a45fb881a538 service nova] Enqueued Resource ID: 7357c39f-354f-4b15-be5d-10792ddb5c54 with Priority: HIGHEST for action port [ 893.907823] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_rules [ 893.908126] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 893.908126] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7357c39f-354f-4b15-be5d-10792ddb5c54 with Priority: HIGHEST for action port [ 893.909037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.909555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.909641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.910987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.911142] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.912977] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.913498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.913589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.913846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.914019] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.914226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.914606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.914606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.914606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.914705] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.916936] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-7357c39f-354f-4b15-be5d-10792ddb5c54 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.916936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.916936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.916936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.916936] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7357c39f-354f-4b15-be5d-10792ddb5c54',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.164536] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaddab6-0327-438e-a968-548042cf4e7a in Status: SUCCESS [ 894.164862] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaddab6-0327-438e-a968-548042cf4e7a deletion is rescheduled due to dependency. [ 894.164862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.422080] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.423514] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.423704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.423918] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7357c39f-354f-4b15-be5d-10792ddb5c54 with status ACTIVE [ 894.424141] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.424668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.424668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.424668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.424800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.425356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.425460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.425522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.425728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.425859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.426139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.426371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.426371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.426706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.426706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.426859] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7357c39f-354f-4b15-be5d-10792ddb5c54 is going to be updated. [ 894.469252] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.469654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.469654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.469830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.470206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.470326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7357c39f-354f-4b15-be5d-10792ddb5c54" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.649777] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 894.650119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.650309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.650545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.650890] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.650953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.650982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.651173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.652028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.652311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.653033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.930453] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.159021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.159021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.159021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.159021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.159021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.159624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.159624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.159624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.159624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.159624] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.433642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.433642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.433642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.433642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.434218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.434218] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be created. [ 895.464795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.464795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.464795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.465057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.465057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.476399] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: UNINITIALIZED for 2s [ 895.567873] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 895.568488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.661656] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bedc55f5-0ad2-4b84-aab1-d26ca6737e7a: rpc.has_security_group_logging(os_id): False [ 895.685227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.685406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.685480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.685699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.710333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.710612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.710791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.710843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.711101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.711197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.711428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.711531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.711633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.711818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.711886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.712094] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.712196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.712250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.712669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.712811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.712988] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 895.786835] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.787275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.787367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.787595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.787751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.802742] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 897.489304] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 897.489671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.489801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.490116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.491278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.491278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.491278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.491278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.491278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.491278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.491278] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.817934] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 897.818179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.997360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.997958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.997958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.997958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.998188] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.998294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.998387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.998574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.998698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.998939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.999110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.999227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.999654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.999654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.999654] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.999789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.999850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.999997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.000085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.000167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.000258] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.502425] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1afa0b0-3cbd-4920-98be-230a695a0592: rpc.has_security_group_logging(os_id): False [ 898.529124] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.529124] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.529124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.529124] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.529844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.530086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.530406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.530758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.531258] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.531538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.531835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.532139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.532507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.533048] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be created. [ 898.595252] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.595426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.595508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.595723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.595937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.611224] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 898.909480] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 898.909632] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 899.600258] env[65222]: INFO networking_nsxv3.common.synchronization [req-25c998bf-71a2-4d54-a6d1-79a71847396c req-8159f92b-027f-4fdb-aea2-1ec739d349d3 tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 899.601094] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 899.601489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.601605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.601678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.601918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.602106] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.602286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.602286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.602575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.602575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.602681] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.082114] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.082114] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.082114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.082114] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.083928] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.084292] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.084519] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.084737] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.085089] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.086206] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.104546] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.108241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.108459] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.108599] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.108781] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.109131] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-c736056d-d4fa-46b8-8041-68edeff377ac taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.110168] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.110168] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.110168] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.110168] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c736056d-d4fa-46b8-8041-68edeff377ac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.494330] env[65222]: INFO networking_nsxv3.common.synchronization [req-35389334-81ef-4c2b-b899-12d8a315d57f req-59b95c8e-36da-4fd2-9a5d-19c7a6c54168 tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 900.494932] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 900.495284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.495428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.495490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.496271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.496271] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.496271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.496271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.496271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.496543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.496543] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.608268] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.614542] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.614948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.615217] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.615616] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.615871] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.616181] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port c736056d-d4fa-46b8-8041-68edeff377ac not found, creating... [ 900.616634] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.617829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.618108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.618447] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.619123] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.619769] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.620173] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.620370] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.620724] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.621228] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.622162] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: c736056d-d4fa-46b8-8041-68edeff377ac is going to be created. [ 900.624962] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 900.625359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.645495] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.645893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.646166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.647463] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.651092] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.651092] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.998984] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.111624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.111624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.111624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.111988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.112182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.112182] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be updated. [ 901.148014] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.148014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.148014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.148181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.148291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.159383] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 901.504648] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.505890] env[65222]: INFO networking_nsxv3.common.synchronization [req-25c998bf-71a2-4d54-a6d1-79a71847396c req-0e649f36-7815-487f-947a-cbe551e5b03c service nova] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_rules [ 901.506793] env[65222]: INFO networking_nsxv3.common.synchronization [req-25c998bf-71a2-4d54-a6d1-79a71847396c req-0e649f36-7815-487f-947a-cbe551e5b03c service nova] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 901.506793] env[65222]: INFO networking_nsxv3.common.synchronization [req-25c998bf-71a2-4d54-a6d1-79a71847396c req-0e649f36-7815-487f-947a-cbe551e5b03c service nova] Enqueued Resource ID: c736056d-d4fa-46b8-8041-68edeff377ac with Priority: HIGHEST for action port [ 901.507914] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_rules [ 901.508234] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 901.508234] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c736056d-d4fa-46b8-8041-68edeff377ac with Priority: HIGHEST for action port [ 901.509030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.509030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.509030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.509030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.509030] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.509834] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.509937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.511141] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c736056d-d4fa-46b8-8041-68edeff377ac taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.511378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.511461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.512128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.512128] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c736056d-d4fa-46b8-8041-68edeff377ac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.008612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.011635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.011635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.011635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.011635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.011635] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be updated. [ 902.016869] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c736056d-d4fa-46b8-8041-68edeff377ac with status ACTIVE [ 902.016869] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.016869] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.016869] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.016869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.017632] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c736056d-d4fa-46b8-8041-68edeff377ac is going to be updated. [ 902.018439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.018585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.045035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.045035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.045035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.045035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.045035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.045035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c736056d-d4fa-46b8-8041-68edeff377ac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.046423] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.046572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.046631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.046884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.047056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.059091] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 902.206208] env[65222]: INFO networking_nsxv3.common.synchronization [req-bc3f7d31-e181-47ca-aae0-600d5f00932e req-7bf350fe-124b-4eab-976d-f877b2e64e15 tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 902.207432] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 902.207432] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.207641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.207713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.207937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.208182] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.208305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.208653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.208653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.208786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.208856] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.702385] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.702385] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.702385] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.703527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.703527] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.703527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.703835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.703995] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.708039] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.708039] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.708039] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.708039] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.708039] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.708039] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.708039] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.708039] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.712154] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.712154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.712154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.712154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.741121] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.741121] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.741121] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.741121] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-795" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.741479] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-c3dab622-093c-4370-941d-280fa632fb95 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.741890] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.741890] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.742335] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.742527] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3dab622-093c-4370-941d-280fa632fb95',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.745632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.745872] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.746248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.746248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.746248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.746367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.746420] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 902.789132] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.789434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.789434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.789648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.789819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.807481] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 903.169808] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 903.170176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.170176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.170381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.170513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.170654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.170713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.171017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.171017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.171148] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.245812] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.245812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.245812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.246357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.246357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.246443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port c3dab622-093c-4370-941d-280fa632fb95 not found, creating... [ 903.247658] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.247658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.247658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.247658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.247658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.248301] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.248301] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.248301] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.248413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.249134] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.249134] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: c3dab622-093c-4370-941d-280fa632fb95 is going to be created. [ 903.273483] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.273483] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.274306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.274306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.274306] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.274626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.675921] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.028892] env[65222]: INFO networking_nsxv3.common.synchronization [req-bc3f7d31-e181-47ca-aae0-600d5f00932e req-3185e2ff-529c-44c8-9f1c-aeaabd20beed service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 904.029693] env[65222]: INFO networking_nsxv3.common.synchronization [req-bc3f7d31-e181-47ca-aae0-600d5f00932e req-3185e2ff-529c-44c8-9f1c-aeaabd20beed service nova] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 904.029693] env[65222]: INFO networking_nsxv3.common.synchronization [req-bc3f7d31-e181-47ca-aae0-600d5f00932e req-3185e2ff-529c-44c8-9f1c-aeaabd20beed service nova] Enqueued Resource ID: c3dab622-093c-4370-941d-280fa632fb95 with Priority: HIGHEST for action port [ 904.029821] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_rules [ 904.029879] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 904.029987] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3dab622-093c-4370-941d-280fa632fb95 with Priority: HIGHEST for action port [ 904.032156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.032645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.033337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.033789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.033789] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.034823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.034938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.035153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3dab622-093c-4370-941d-280fa632fb95 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.035721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.035721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.035721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.035721] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3dab622-093c-4370-941d-280fa632fb95',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.070026] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 904.070329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.178387] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.537930] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.538065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.538259] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3dab622-093c-4370-941d-280fa632fb95 with status ACTIVE [ 904.538437] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.538541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.538607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.538845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.538932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.539119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.539212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.539271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.539417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.539488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.539667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.539763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.539828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.539961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.540220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.540220] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3dab622-093c-4370-941d-280fa632fb95 is going to be updated. [ 904.566126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.566126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.566445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.566557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.567491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.567491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3dab622-093c-4370-941d-280fa632fb95" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.681113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.681113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.681113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.681113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.681263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.681291] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be updated. [ 904.732084] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.732247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.732319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.732538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.732683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.745167] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 904.820141] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 904.820279] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 deletion is rescheduled due to dependency. [ 904.820386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.821438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.821438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.821636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.821766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.821839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.822012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.822102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.822268] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.965602] env[65222]: INFO networking_nsxv3.common.synchronization [req-4e4d08b8-a9b2-4217-b668-01cdf314bb49 req-fff532a2-4810-4985-b901-0a0765b5ca74 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 904.966498] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 904.966940] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.967130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.967228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.967764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.968030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.968187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.968921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.969194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.969435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.969516] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.303263] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.303549] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.303640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.303947] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.304229] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.304752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.304951] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.305223] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.305371] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.305584] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.305752] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.305990] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.306109] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.306253] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.306388] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.306528] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.325399] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.327034] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.327767] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.328025] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.330019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.330019] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-ceb3117c-785b-48a9-a912-2653a729b127 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.330019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.330019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.330019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.330019] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb3117c-785b-48a9-a912-2653a729b127',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.473696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.473696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.473696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 already deleted. [ 905.473696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.832326] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.833647] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.833866] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.834055] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.834373] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.834547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.834734] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port ceb3117c-785b-48a9-a912-2653a729b127 not found, creating... [ 905.835044] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.835281] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.835452] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835701] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.836600] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.836600] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.836600] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.836800] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.836958] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.838369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: ceb3117c-785b-48a9-a912-2653a729b127 is going to be created. [ 905.857270] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.858889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.858889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.858889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.858889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.858889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340220] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.340220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.340220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.340220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.340220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340220] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 906.374693] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.374860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.374903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.375186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.375389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.387234] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 906.648603] env[65222]: INFO networking_nsxv3.common.synchronization [req-4e4d08b8-a9b2-4217-b668-01cdf314bb49 req-20c8805c-492c-4ac5-956a-20e24f2c743c service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 906.648603] env[65222]: INFO networking_nsxv3.common.synchronization [req-4e4d08b8-a9b2-4217-b668-01cdf314bb49 req-20c8805c-492c-4ac5-956a-20e24f2c743c service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 906.648603] env[65222]: INFO networking_nsxv3.common.synchronization [req-4e4d08b8-a9b2-4217-b668-01cdf314bb49 req-20c8805c-492c-4ac5-956a-20e24f2c743c service nova] Enqueued Resource ID: ceb3117c-785b-48a9-a912-2653a729b127 with Priority: HIGHEST for action port [ 906.648603] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 906.650114] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 906.651028] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb3117c-785b-48a9-a912-2653a729b127 with Priority: HIGHEST for action port [ 906.651518] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.651667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.651843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.652194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.652825] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.653681] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.653793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.653911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.654299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.654511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.654661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.654788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.655078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.655186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.655306] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.657121] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceb3117c-785b-48a9-a912-2653a729b127 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.657360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.658790] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb3117c-785b-48a9-a912-2653a729b127',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.758076] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 906.758692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.758928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.759277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.759565] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.759716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.759840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.759946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.760045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.760149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.760289] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.161801] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.162847] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.162966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.163294] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ceb3117c-785b-48a9-a912-2653a729b127 with status ACTIVE [ 907.163294] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.163576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.163576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.163671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.163704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.163876] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.164018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.164092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.164249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.164325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.164503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.164596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.164655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.164789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.164860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.165283] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ceb3117c-785b-48a9-a912-2653a729b127 is going to be updated. [ 907.192990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.193554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.194812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.194812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.194812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.194812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceb3117c-785b-48a9-a912-2653a729b127" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.265367] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.265813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.265978] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.266114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.266153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.266295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.266379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.266473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.266605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.266711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.266778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.266917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.267037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.267131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.267189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.267320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.267393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.267472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.267561] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.666875] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.770310] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1afa0b0-3cbd-4920-98be-230a695a0592: rpc.has_security_group_logging(os_id): False [ 907.790198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.791009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.791009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.791009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.791009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.791009] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.791232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.791232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.791284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.791310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.791517] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.793027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.793027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.793027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be updated. [ 907.860036] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.860036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.860036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.860036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.860036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.873682] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 908.170806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.170806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.170806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.171330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.171330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.171330] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be created. [ 908.185550] env[65222]: INFO networking_nsxv3.common.synchronization [req-ad542469-5a9c-42d2-b8b0-4c085c9da245 req-89e96a18-7008-46b8-9838-2fdea45b5dfc tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 908.186339] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 908.186496] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.186585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.186653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.186866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.187458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.187577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.187632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.187813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.187943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.188009] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.199138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.199339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.199411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.199600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.199770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.213045] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: UNINITIALIZED for 2s [ 908.398573] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 908.399795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.399795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.399926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.400363] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.400613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.400881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.401043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.401165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.401302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.401481] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.691900] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.904905] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.905049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.905126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.905347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.905506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.905606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.905671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.905881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.905916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.905980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.906139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.906233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.906295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.906435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.906571] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.906661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.906721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.906858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.906927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.907208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.907208] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.195999] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.409051] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a1f130e-cc8b-4415-87be-b7a8cbdda189: rpc.has_security_group_logging(os_id): False [ 909.416871] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-8ff16fa7-095e-4f5c-ba18-5c8312a29ce2 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 909.417567] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 909.417763] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.417877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.417953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.418160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.418320] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.418419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.418484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.418636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.418722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.418853] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.428439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.428745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.428852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.429713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.429857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.430314] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.430928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.431021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.431381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.431472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.431912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.432022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.432090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.432525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.432801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.433352] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.433484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.433690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.433870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.434453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.434556] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 909.510646] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.510854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.510934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.511213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.511484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.524459] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 909.699757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.700217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.700217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.701859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.702117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.702117] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 909.759472] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.759693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.759772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.760030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.761161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.775820] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 909.891838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 909.892067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.919937] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-498eb9a9-f8e1-4657-a9ca-5aae617a5db6 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 909.920814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.920972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.921061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.921302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.921394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.921648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.921737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.921787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.921977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.922073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.922164] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 909.922249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.922426] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 909.923174] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.923328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.923403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.923556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.923733] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.923839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.923892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.924228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.924228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.924228] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.226826] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.226826] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.226826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.226826] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.269964] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.270219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-584" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.270372] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-584" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.270864] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-584" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.271135] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.271327] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.271570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.271866] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.272114] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.272370] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.272491] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.272610] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.273077] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.273077] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.273077] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.273077] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.303645] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.303806] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.303963] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.304173] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-584" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.304505] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2b32a0b8-302f-4746-a332-69e2b5f475e4 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.304724] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.304864] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.305289] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.305453] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b32a0b8-302f-4746-a332-69e2b5f475e4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.428742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.428742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.428742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.428742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.428742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.429079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.429079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.429154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.430171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.430171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.430171] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb already deleted. [ 910.430171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.731181] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.810674] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.810960] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.811116] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.811396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.811547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.811739] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 2b32a0b8-302f-4746-a332-69e2b5f475e4 not found, creating... [ 910.812397] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.812397] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.812566] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.812831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.812973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.813284] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.813438] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.813574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.813812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.813949] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.814105] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2b32a0b8-302f-4746-a332-69e2b5f475e4 is going to be created. [ 910.834731] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.834731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.834731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.835018] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.835109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.835387] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.234174] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deb58d10-eb3b-46ea-87ea-d75bc77a65e2: rpc.has_security_group_logging(os_id): False [ 911.258191] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.258350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.258402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.258613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.258708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.258950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.259065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.259161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.259284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.259356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.259445] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be created. [ 911.342423] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.342615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.342653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.342975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.343284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.355815] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 911.539616] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 911.539913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.632547] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-69a44061-79e9-4bb0-b95f-0b6c3c7dff15 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 911.632724] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-69a44061-79e9-4bb0-b95f-0b6c3c7dff15 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 911.632958] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-69a44061-79e9-4bb0-b95f-0b6c3c7dff15 service nova] Enqueued Resource ID: 2b32a0b8-302f-4746-a332-69e2b5f475e4 with Priority: HIGHEST for action port [ 911.633588] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 911.633738] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 911.633851] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b32a0b8-302f-4746-a332-69e2b5f475e4 with Priority: HIGHEST for action port [ 911.634197] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.634292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.634359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.634583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.634655] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.636047] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.636180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.636250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.636430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.636600] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.636700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.636778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.636943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.637108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.637171] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.637942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b32a0b8-302f-4746-a332-69e2b5f475e4 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.638944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.638944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.638944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.638944] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b32a0b8-302f-4746-a332-69e2b5f475e4',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.791574] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 911.791953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.140494] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.140934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.141180] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.142672] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b32a0b8-302f-4746-a332-69e2b5f475e4 with status ACTIVE [ 912.142672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.142672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.142862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.143079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.143154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.143342] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.143487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.143554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.143714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.143821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.144189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.144189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.144372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.144372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.144474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.144523] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b32a0b8-302f-4746-a332-69e2b5f475e4 is going to be updated. [ 912.174374] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.174594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.174664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.174834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.174967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.175162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b32a0b8-302f-4746-a332-69e2b5f475e4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.475441] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.475780] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-734" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.476029] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-734" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.477436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-734" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.477436] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.477436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.477436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.477674] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.477786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.478045] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.478203] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.478337] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.478484] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.478856] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.478978] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.479194] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.503132] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.503338] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.503514] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.503711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-734" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.504045] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-794703c0-2d94-46ae-adb4-d8072133c271 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.504229] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.504347] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.504701] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.504845] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794703c0-2d94-46ae-adb4-d8072133c271',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.646729] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.008195] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.008594] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.008803] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.009207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.009421] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.009643] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 794703c0-2d94-46ae-adb4-d8072133c271 not found, creating... [ 913.010108] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.010267] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.010440] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.010748] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.010976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.011362] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.011574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.011742] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.012020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.012200] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.012382] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 794703c0-2d94-46ae-adb4-d8072133c271 is going to be created. [ 913.036327] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.036539] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.036659] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.036932] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.037175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.037403] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.149550] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.149717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.149781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.150010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.150091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.150196] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be created. [ 913.195847] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.196095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.196220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.196521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.196723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.214878] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: UNINITIALIZED for 2s [ 913.371488] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 913.371842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.769221] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-746d7f2d-a781-4043-8820-558efd55cbc5 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 913.769221] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-746d7f2d-a781-4043-8820-558efd55cbc5 service nova] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 913.769221] env[65222]: INFO networking_nsxv3.common.synchronization [req-a7296376-0f0f-45f4-b00a-e79130c224e4 req-746d7f2d-a781-4043-8820-558efd55cbc5 service nova] Enqueued Resource ID: 794703c0-2d94-46ae-adb4-d8072133c271 with Priority: HIGHEST for action port [ 913.770466] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_rules [ 913.770807] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 913.771200] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794703c0-2d94-46ae-adb4-d8072133c271 with Priority: HIGHEST for action port [ 913.774022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.774022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.774022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.774022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.774022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-794703c0-2d94-46ae-adb4-d8072133c271 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.774022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.774022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.774022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.774022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794703c0-2d94-46ae-adb4-d8072133c271',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.279288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 794703c0-2d94-46ae-adb4-d8072133c271 with status ACTIVE [ 914.279605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.279682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.279729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.279932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.280044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.280239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.280338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.280415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.280573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.280662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.280931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.281041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.281107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.281263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.281337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.281435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 794703c0-2d94-46ae-adb4-d8072133c271 is going to be updated. [ 914.327273] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.327438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.327487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.327697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.327828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.327989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-794703c0-2d94-46ae-adb4-d8072133c271" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.895681] env[65222]: INFO networking_nsxv3.common.synchronization [req-52d00d8b-2304-462f-93dc-8122cd618816 req-89290371-6589-41bb-aed5-a785ddfe8d51 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 914.896393] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 914.896943] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.896943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.896943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.898348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.898552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.898696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.898757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.898968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.899080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.899167] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.228041] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: UNINITIALIZED for 4s [ 915.315244] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.315244] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.316098] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.316098] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.316429] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.316698] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.316852] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.317132] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.317313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.317553] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.317696] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.317829] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.317961] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.318230] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.318230] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.318976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.339692] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.339692] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.339876] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.340030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.340359] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-0f123aad-b670-4d07-8ded-84a8c071d7bf taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.340527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.340645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.341081] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.341227] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f123aad-b670-4d07-8ded-84a8c071d7bf',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.403599] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.403769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.403841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.404151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.404261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.404462] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.404590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.404655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.404823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.404877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.407129] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 915.441733] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.441962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.442030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.442271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.442428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.456984] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 915.843298] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.843612] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.843706] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.843980] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.844155] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.844316] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 0f123aad-b670-4d07-8ded-84a8c071d7bf not found, creating... [ 915.844677] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.844997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.845078] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.845778] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.845778] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.845778] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.845961] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.845994] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.846229] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.846364] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.846503] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 0f123aad-b670-4d07-8ded-84a8c071d7bf is going to be created. [ 915.872685] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.872685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.872685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.872685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.872685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.873193] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.383704] env[65222]: INFO networking_nsxv3.common.synchronization [req-89da945d-f743-4018-813a-5d118e673615 req-0d9964df-b5bf-4bc3-b153-a6072597947e tempest-ImagesOneServerNegativeTestJSON-529950237 tempest-ImagesOneServerNegativeTestJSON-529950237-project-member] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 916.384260] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGHEST for action security_group_members [ 916.384558] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.384729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.384798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.384947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.385119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.385278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.385278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.385426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.385509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.385599] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.641681] env[65222]: INFO networking_nsxv3.common.synchronization [req-52d00d8b-2304-462f-93dc-8122cd618816 req-c522abd0-503c-445a-83cc-0ff2ebb364d3 service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 916.641867] env[65222]: INFO networking_nsxv3.common.synchronization [req-52d00d8b-2304-462f-93dc-8122cd618816 req-c522abd0-503c-445a-83cc-0ff2ebb364d3 service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 916.642062] env[65222]: INFO networking_nsxv3.common.synchronization [req-52d00d8b-2304-462f-93dc-8122cd618816 req-c522abd0-503c-445a-83cc-0ff2ebb364d3 service nova] Enqueued Resource ID: 0f123aad-b670-4d07-8ded-84a8c071d7bf with Priority: HIGHEST for action port [ 916.642636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 916.642760] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 916.642861] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f123aad-b670-4d07-8ded-84a8c071d7bf with Priority: HIGHEST for action port [ 916.645532] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.646223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.646360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.647836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.647966] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.649580] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.649675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.649903] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f123aad-b670-4d07-8ded-84a8c071d7bf taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.650900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.650900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.650900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.650900] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f123aad-b670-4d07-8ded-84a8c071d7bf',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.889278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.889502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.889585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.889802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.889896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.890162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.890279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.890347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.890498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.890571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.890675] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be updated. [ 916.923311] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.923485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.923545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.923773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.923907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.948516] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: IN_PROGRESS for 2s [ 917.150543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.150543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.152976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f123aad-b670-4d07-8ded-84a8c071d7bf with status ACTIVE [ 917.153163] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.153301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.153389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.154047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.154174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.154390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.154518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.154579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.156021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156021] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f123aad-b670-4d07-8ded-84a8c071d7bf is going to be updated. [ 917.182863] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.183025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.183121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.183397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.183501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.183622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f123aad-b670-4d07-8ded-84a8c071d7bf" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.257027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.257027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.257027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.257027] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.261172] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.261172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.261172] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.472660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 917.473419] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 917.473419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.473419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.473594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.473812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.474295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.474295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.474295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.474295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.474295] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.765454] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.765454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.765454] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.979387] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.266926] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.482358] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.769885] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.769885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.769885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.770371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.770606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.770606] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 918.810773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.811030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.811106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.811383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.811534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.822901] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 918.965496] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 in Status: SUCCESS [ 918.965818] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 deletion is rescheduled due to dependency. [ 918.965870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.985935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.986140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.986195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.986514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.986687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.986882] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 919.017588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.022223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.022223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.022223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.022223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.034892] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 920.950283] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 920.950552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.950552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.950806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.951236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.951348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.951383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.951545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.951629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.951722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.951917] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.951988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.952135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.952321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.952472] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.952565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.952628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.952770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.952846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.952929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.953033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.047561] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 921.047806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.048425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.048915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.049147] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.049291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.049380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.049571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.049656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.049753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.049863] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.455308] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 013f0bc7-93b5-439a-93c1-4391408844fb: rpc.has_security_group_logging(os_id): False [ 921.475680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.475680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.475680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.476104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.476104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.477290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.477290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.477290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.477790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.477790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.478674] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.478674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.478674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.478674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.478674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.478674] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be created. [ 921.552457] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.553056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.553056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.553221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.553407] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.553512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.553590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.553853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.554013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.555913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.555913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.555913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.556509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.556509] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.560028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.560771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.560771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.560914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.561942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.575913] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 921.643993] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 921.644114] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 922.063050] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 922.086030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.086030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.086030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.086417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.086417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.086417] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.086510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.086537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.086765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.087325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.087325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.087325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.087492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.087551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.087648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.087737] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 922.161678] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.161875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.162008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.162288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.162425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.178855] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 923.594288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 923.594635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.594635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.595235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.595235] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.097728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.098111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.098266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.098689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.098960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.099124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.099181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.099496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.099687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.099802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.100260] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.197253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 924.197381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.603442] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.603764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.603764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.604074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.604283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.604430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.604519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.604741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.604858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.604978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.605192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.605345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.605411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.605586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.605784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.606043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.606043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.606989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.606989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.606989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.606989] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.109768] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 013f0bc7-93b5-439a-93c1-4391408844fb: rpc.has_security_group_logging(os_id): False [ 925.130820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.131045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.131201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.131344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.131434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.131645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.131743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.131805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.131949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.132108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.132304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.132403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.132462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.132603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.132676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.132868] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.132957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.133132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.133333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.133433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.133542] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 925.213445] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.213445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.213445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.213638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.213687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.249905] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 925.465363] env[65222]: INFO networking_nsxv3.common.synchronization [req-29f0ebf5-43f5-4699-84f3-e0bd8aac7000 req-ca5f5aaa-24f0-4d75-93aa-1e2199f6656d tempest-ServerDiagnosticsTest-591766268 tempest-ServerDiagnosticsTest-591766268-project-member] Enqueued Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 925.465658] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 925.465989] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.466143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.466241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.466552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.466744] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.466855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.466933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.467118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.467202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.467311] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.943311] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.943715] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.943715] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.946160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.946160] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.946160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.946160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.946160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.946160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.946160] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.946160] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.946160] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.946160] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.946160] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.946160] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.946160] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.967918] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.968143] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.968236] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.968414] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.968812] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-88393b6e-8044-4155-86d6-d64883b0e9fd taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.968986] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.969115] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.969542] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.969705] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88393b6e-8044-4155-86d6-d64883b0e9fd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.971216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.971333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.971391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.971572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.971651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.971950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.972134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.973027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.973027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.973027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.973027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39045f59-5600-413e-a6df-437146897c8f already deleted. [ 925.973027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.474245] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.474470] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.474595] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.474880] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.475057] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.475223] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 88393b6e-8044-4155-86d6-d64883b0e9fd not found, creating... [ 926.475482] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.475627] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.475745] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.475968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.476118] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.477870] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.477870] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.477870] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.477870] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.477870] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.477870] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 88393b6e-8044-4155-86d6-d64883b0e9fd is going to be created. [ 926.500058] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.500278] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.500381] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.500665] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.500964] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.501201] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.647909] env[65222]: INFO networking_nsxv3.common.synchronization [None req-308ce096-33e7-4626-a1c0-61753a09fc31 None None] Enqueued Resource ID: 6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2 with Priority: HIGHEST for action port [ 926.648544] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2 with Priority: HIGHEST for action port [ 926.649138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.649138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.649138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.649620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.649991] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.152720] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2 [ 927.153109] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.153462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.153747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.153780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.153875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.153972] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2 already deleted. [ 927.154067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b6f2bdd-8fc4-4f82-adfe-6f42f557aed2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.250180] env[65222]: INFO networking_nsxv3.common.synchronization [req-29f0ebf5-43f5-4699-84f3-e0bd8aac7000 req-9d67d740-fdb0-443d-b9b8-b04f08d6da9f service nova] Enqueued Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_rules [ 927.252048] env[65222]: INFO networking_nsxv3.common.synchronization [req-29f0ebf5-43f5-4699-84f3-e0bd8aac7000 req-9d67d740-fdb0-443d-b9b8-b04f08d6da9f service nova] Enqueued Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 927.252048] env[65222]: INFO networking_nsxv3.common.synchronization [req-29f0ebf5-43f5-4699-84f3-e0bd8aac7000 req-9d67d740-fdb0-443d-b9b8-b04f08d6da9f service nova] Enqueued Resource ID: 88393b6e-8044-4155-86d6-d64883b0e9fd with Priority: HIGHEST for action port [ 927.254068] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_rules [ 927.254202] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 927.254298] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88393b6e-8044-4155-86d6-d64883b0e9fd with Priority: HIGHEST for action port [ 927.255104] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.256222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.256222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.256222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.256222] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.258951] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.258951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.258951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.259227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.259428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.259562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.259652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.259826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.260085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.260085] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.261684] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-88393b6e-8044-4155-86d6-d64883b0e9fd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.261830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.261931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.262137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.262237] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88393b6e-8044-4155-86d6-d64883b0e9fd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.278134] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 927.278482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.542457] env[65222]: INFO networking_nsxv3.common.synchronization [req-dccdce27-6f91-4389-a9a3-d946717f01ad req-6371e836-d8be-4ee3-9d3a-89a6d46a2108 tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 927.542457] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 927.544087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.544406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.544865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.545243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.545859] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.546198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.546589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.548048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.548048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.548048] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.759177] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.759622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.763975] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.771022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88393b6e-8044-4155-86d6-d64883b0e9fd with status ACTIVE [ 927.771022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.771022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.771022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.771022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.771022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88393b6e-8044-4155-86d6-d64883b0e9fd is going to be updated. [ 927.796127] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.796580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.796580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.796580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.796916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.796916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88393b6e-8044-4155-86d6-d64883b0e9fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.827854] env[65222]: INFO networking_nsxv3.common.synchronization [req-dccdce27-6f91-4389-a9a3-d946717f01ad req-31783582-b3a3-4f88-bdde-b259bfbdedca tempest-ServersTestMultiNic-1770909578 tempest-ServersTestMultiNic-1770909578-project-member] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 927.828428] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGHEST for action security_group_members [ 927.829826] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.829930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.053057] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.271799] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.556217] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.772441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.772601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.772676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.772966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.773084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.773201] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39045f59-5600-413e-a6df-437146897c8f is going to be created. [ 928.813173] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.813494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.813494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.813782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.813782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.827976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: UNINITIALIZED for 2s [ 928.927717] env[65222]: INFO networking_nsxv3.common.synchronization [None req-1c367029-358a-4212-8b83-820c32a1ec33 None None] Enqueued Resource ID: 96ed1f2b-9c90-4ed1-9a50-9d88d5564094 with Priority: HIGHEST for action port [ 928.929441] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ed1f2b-9c90-4ed1-9a50-9d88d5564094 with Priority: HIGHEST for action port [ 928.929441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-96ed1f2b-9c90-4ed1-9a50-9d88d5564094 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.929441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96ed1f2b-9c90-4ed1-9a50-9d88d5564094" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.929441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96ed1f2b-9c90-4ed1-9a50-9d88d5564094" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.929441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96ed1f2b-9c90-4ed1-9a50-9d88d5564094" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.929441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96ed1f2b-9c90-4ed1-9a50-9d88d5564094',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.059551] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.059780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.059879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.060173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.060359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.060484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 929.095815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.096050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.096160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.096383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.096527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.107157] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 929.433984] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96ed1f2b-9c90-4ed1-9a50-9d88d5564094 [ 929.434669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.434857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.435420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.435650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.435746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.436062] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96ed1f2b-9c90-4ed1-9a50-9d88d5564094 already deleted. [ 929.436215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96ed1f2b-9c90-4ed1-9a50-9d88d5564094" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.097974] env[65222]: INFO networking_nsxv3.common.synchronization [req-04d894d3-7080-4e57-a8c8-65898da0a290 req-c3210dd7-67e9-4fef-8d58-19bbe79a5722 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 930.098809] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 930.099208] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.099395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.099443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.099677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.099855] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.099961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.100035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.100212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.100312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.100411] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.603638] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.604103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.604103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.604103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.604270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.604398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.604501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.604560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.604715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.604791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.604875] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 930.635620] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.635829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.635928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.636278] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.636560] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.636724] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.636842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.637075] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.637387] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.637659] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.637774] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.637885] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.637992] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.638248] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.638248] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.638380] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.642696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.642696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.642696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.642933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.643055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.652394] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 930.659489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.659489] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.659644] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.659854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660119] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2e7029c8-9cc0-4175-afb0-724671e0745f taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660340] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660438] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.661447] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.661447] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e7029c8-9cc0-4175-afb0-724671e0745f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.841663] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: SUCCESS [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.844321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.844321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.844321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.118254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 931.118481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.118652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.118927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.119191] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.119334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.119393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.119620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.119917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.120136] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.163939] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.163939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.163939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.164342] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.164586] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.164898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 2e7029c8-9cc0-4175-afb0-724671e0745f not found, creating... [ 931.165366] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.165515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.165720] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.165980] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.168047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.168047] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.168047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.168047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.168658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.168729] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.169239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2e7029c8-9cc0-4175-afb0-724671e0745f is going to be created. [ 931.192986] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.193166] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.193321] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.193557] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.195571] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.195571] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.346950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.347156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.347236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.347464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.347636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.347743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.347809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.347958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.348074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.348176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.348326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.348435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.348484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.348848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.348848] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.348848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.349152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.349152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.349274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.349274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.349374] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.623548] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.623548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.623548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.623548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.624034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.624034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.624034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.624034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.624178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.624206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.624294] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be updated. [ 931.653841] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.653841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.653841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.654158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.654779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.665616] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: IN_PROGRESS for 2s [ 931.853731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39045f59-5600-413e-a6df-437146897c8f: rpc.has_security_group_logging(os_id): False [ 931.876856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.876982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.877300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.877370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.877416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.877646] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.877750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.877818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.878031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.878114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.878307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.878406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.878467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.878679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.878797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880180] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.880302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.880302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.880477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.880961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.881103] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39045f59-5600-413e-a6df-437146897c8f is going to be created. [ 931.957651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.957651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.957651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.957651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.957651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.979743] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: IN_PROGRESS for 2s [ 932.022051] env[65222]: INFO networking_nsxv3.common.synchronization [req-04d894d3-7080-4e57-a8c8-65898da0a290 req-41d4e415-f1c0-472b-bb27-42be2c3780c7 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 932.022440] env[65222]: INFO networking_nsxv3.common.synchronization [req-04d894d3-7080-4e57-a8c8-65898da0a290 req-41d4e415-f1c0-472b-bb27-42be2c3780c7 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 932.022519] env[65222]: INFO networking_nsxv3.common.synchronization [req-04d894d3-7080-4e57-a8c8-65898da0a290 req-41d4e415-f1c0-472b-bb27-42be2c3780c7 service nova] Enqueued Resource ID: 2e7029c8-9cc0-4175-afb0-724671e0745f with Priority: HIGHEST for action port [ 932.023262] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 932.023432] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 932.024039] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7029c8-9cc0-4175-afb0-724671e0745f with Priority: HIGHEST for action port [ 932.024039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.024260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.024260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.024798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.024798] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.025950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.026069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.026311] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e7029c8-9cc0-4175-afb0-724671e0745f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.026430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.026514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.026717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.026804] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e7029c8-9cc0-4175-afb0-724671e0745f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.529335] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.529546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.531527] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e7029c8-9cc0-4175-afb0-724671e0745f with status ACTIVE [ 932.531527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.531527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.531527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.531527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.532149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.532149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.532149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.532149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.532149] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e7029c8-9cc0-4175-afb0-724671e0745f is going to be updated. [ 932.565202] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.565351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.566098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.566098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.566098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.566098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e7029c8-9cc0-4175-afb0-724671e0745f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.663190] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 932.663558] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 932.663558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.663727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.664201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.664316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.664386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.664434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.664604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.664689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.664789] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.167183] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.671435] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.687492] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 013f0bc7-93b5-439a-93c1-4391408844fb in Status: SUCCESS [ 933.687697] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb deletion is rescheduled due to dependency. [ 933.687809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.994646] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: SUCCESS [ 933.994646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.177174] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.177253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.177305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.177564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.177659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.177754] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 934.216788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.216877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.217193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.217971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.217971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.228437] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 934.784206] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ccc93e41-e9bd-4b9a-a57f-dd5e9b869796 None None] Enqueued Resource ID: 1c9f32d6-24a2-421e-a660-90d08e697eb0 with Priority: HIGHEST for action port [ 934.785318] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9f32d6-24a2-421e-a660-90d08e697eb0 with Priority: HIGHEST for action port [ 934.785649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c9f32d6-24a2-421e-a660-90d08e697eb0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.785779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c9f32d6-24a2-421e-a660-90d08e697eb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.785841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c9f32d6-24a2-421e-a660-90d08e697eb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.787010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c9f32d6-24a2-421e-a660-90d08e697eb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.787143] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c9f32d6-24a2-421e-a660-90d08e697eb0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.291911] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c9f32d6-24a2-421e-a660-90d08e697eb0 [ 935.291911] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.291911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.291911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.291911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.291911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.291911] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c9f32d6-24a2-421e-a660-90d08e697eb0 already deleted. [ 935.291911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c9f32d6-24a2-421e-a660-90d08e697eb0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.397537] env[65222]: INFO networking_nsxv3.common.synchronization [req-12a01174-861c-473e-80a5-55fc4faa1327 req-e6422a38-a7b1-498e-aeed-64cba4c59bc5 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 935.399198] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 935.399572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.399676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.399753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.399952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.400139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.400272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.400359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.400521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.400618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.400715] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.831639] env[65222]: INFO networking_nsxv3.common.synchronization [req-e284c122-4d39-43a6-ae57-d6e809e6278f req-7eea2297-da3b-471c-b2ae-13c29eafe310 tempest-MigrationsAdminTest-837722030 tempest-MigrationsAdminTest-837722030-project-member] Enqueued Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 935.832401] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c36af1-3224-4449-b91e-20d98bbff745 with Priority: HIGHEST for action security_group_members [ 935.832752] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c36af1-3224-4449-b91e-20d98bbff745 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.832924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.832980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.833186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.833396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.833490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.833561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.835049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.835049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.835049] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c36af1-3224-4449-b91e-20d98bbff745',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.904452] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.247257] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 936.247529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.247759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.248068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.248427] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.248709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.248709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.248709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.248866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.248866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.248948] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.336441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.336653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.336735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.336994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.359988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.360292] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.360402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.360493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.360722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.360856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.360890] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 is going to be updated. [ 936.397139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.397139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.397439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.406652] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.409837] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: IN_PROGRESS for 2s [ 936.752211] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.752489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.752489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.752726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.752899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.752996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.753115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.753389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.753448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.753545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.753706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.753806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.753865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.754195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.754281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.754375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.754432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.754595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.754675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.754758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.754849] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.912400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.912783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.912783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.912969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.913050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.913171] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 936.957785] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.958140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.958140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.958342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.958510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.970805] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 937.258140] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 937.286854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.287101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.287101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.287401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.287507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.287993] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.287993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.288148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.288270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.288361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.288604] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.288751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.288790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.288980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.289055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.289419] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.289419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.289549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.289592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.289668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.289804] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 937.388087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.388371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.388371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.388838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.388838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.406316] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 937.441282] env[65222]: INFO networking_nsxv3.common.synchronization [req-9300dbe7-47bf-4611-a287-ddb5b3d1be0b req-d0f77714-33b3-47dc-a788-71b49640220f tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 937.441743] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 937.442965] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.442965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.442965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.442965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.442965] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.442965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.442965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.443473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.443473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.443473] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.493905] env[65222]: INFO networking_nsxv3.common.synchronization [None req-2eb6c44e-ce11-47ea-91d7-491b025aba0d None None] Enqueued Resource ID: dc705b4b-2576-48a8-98b0-06309d8a5401 with Priority: HIGHEST for action port [ 937.494510] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc705b4b-2576-48a8-98b0-06309d8a5401 with Priority: HIGHEST for action port [ 937.494839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc705b4b-2576-48a8-98b0-06309d8a5401 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.494999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc705b4b-2576-48a8-98b0-06309d8a5401" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.495202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc705b4b-2576-48a8-98b0-06309d8a5401" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.495395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc705b4b-2576-48a8-98b0-06309d8a5401" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.495715] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc705b4b-2576-48a8-98b0-06309d8a5401',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.946072] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.998264] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc705b4b-2576-48a8-98b0-06309d8a5401 [ 937.998830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.001098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.001098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.001098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.001098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.001098] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc705b4b-2576-48a8-98b0-06309d8a5401 already deleted. [ 938.001098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc705b4b-2576-48a8-98b0-06309d8a5401" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.026503] env[65222]: INFO networking_nsxv3.common.synchronization [req-c45ac922-848d-4cc8-a97b-d5f20cc183ae req-df8cc7b7-ec4b-4b19-98ec-bb686482415e tempest-ListServersNegativeTestJSON-625704867 tempest-ListServersNegativeTestJSON-625704867-project-member] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 938.026503] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGHEST for action security_group_members [ 938.026503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.026503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.361458] env[65222]: INFO networking_nsxv3.common.synchronization [req-e12ccf11-fc10-40bb-9a38-07fc0bfac5d7 req-c9846b31-c750-4858-8773-a00934e4542f tempest-ServerGroupTestJSON-1437184414 tempest-ServerGroupTestJSON-1437184414-project-member] Enqueued Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 938.362211] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 938.362443] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.362565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.362631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.362889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.363146] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.363243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.363243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.363413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.363500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.363593] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.421406] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c36af1-3224-4449-b91e-20d98bbff745 in Status: SUCCESS [ 938.421770] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c36af1-3224-4449-b91e-20d98bbff745 deletion is rescheduled due to dependency. [ 938.421939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c36af1-3224-4449-b91e-20d98bbff745" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.449528] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.720161] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-163 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.720441] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.720533] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.720814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.721435] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.721618] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.721812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.722519] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.722519] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.722519] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.722686] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.722763] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.722859] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.722971] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.723105] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.723260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.744924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.745018] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.745230] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.745443] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-163" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.745765] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-26106805-0ecb-4f07-8e19-7d021437dbda taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.745952] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.746071] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.746427] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.746583] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26106805-0ecb-4f07-8e19-7d021437dbda',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.866100] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.866324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.866402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.866771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.866898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.867150] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.867263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.867333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.867625] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.867746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.867865] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c already deleted. [ 938.867953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.953096] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.953096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.953096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.953096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.953096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.953096] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 938.983193] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 938.983541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.985950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.986161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.986242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.986447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.986591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.996124] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 939.249249] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.249532] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.249662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.249954] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.250131] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.250290] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 26106805-0ecb-4f07-8e19-7d021437dbda not found, creating... [ 939.250560] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.250713] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.250830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.251086] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.251230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.251519] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.251694] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.251811] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.252039] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.252203] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.252350] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 26106805-0ecb-4f07-8e19-7d021437dbda is going to be created. [ 939.274097] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.274344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.274452] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.274733] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.274967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.275254] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.419823] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 939.420122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.004475] env[65222]: INFO networking_nsxv3.common.synchronization [req-e12ccf11-fc10-40bb-9a38-07fc0bfac5d7 req-186afefc-43b6-4aaf-a855-2c58e7e542f1 service nova] Enqueued Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_rules [ 940.004819] env[65222]: INFO networking_nsxv3.common.synchronization [req-e12ccf11-fc10-40bb-9a38-07fc0bfac5d7 req-186afefc-43b6-4aaf-a855-2c58e7e542f1 service nova] Enqueued Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 940.004931] env[65222]: INFO networking_nsxv3.common.synchronization [req-e12ccf11-fc10-40bb-9a38-07fc0bfac5d7 req-186afefc-43b6-4aaf-a855-2c58e7e542f1 service nova] Enqueued Resource ID: 26106805-0ecb-4f07-8e19-7d021437dbda with Priority: HIGHEST for action port [ 940.006143] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_rules [ 940.006143] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 940.006143] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26106805-0ecb-4f07-8e19-7d021437dbda with Priority: HIGHEST for action port [ 940.006754] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.006925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.007034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.007222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.007310] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.008926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.009094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.009159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.009470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.009506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.010553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.010553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.010553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.010553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.010553] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.011139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-26106805-0ecb-4f07-8e19-7d021437dbda taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.011139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.012114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.012114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.012114] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26106805-0ecb-4f07-8e19-7d021437dbda',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.124061] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d1d45c6-f0fc-4e81-bff9-011d7f3ae07f req-b17dfe37-bc29-48c6-9ab9-72506070c7e4 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 940.124670] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 940.125171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.125305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.125376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.125582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.125765] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.126205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.126434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.126612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.126705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.126805] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.508367] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.508568] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.508689] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.508957] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.509232] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.509389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.509504] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.509714] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.509859] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.510078] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.510192] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.510300] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.510409] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.510517] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.510618] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.510747] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.513679] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.514544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.514646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.514968] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26106805-0ecb-4f07-8e19-7d021437dbda with status ACTIVE [ 940.518030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.518030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.518030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.518030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.518030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26106805-0ecb-4f07-8e19-7d021437dbda is going to be updated. [ 940.536176] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.536360] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.537093] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.537093] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.537093] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-2347719f-c962-4b0a-9bb0-67fbda2a73fb taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.537360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.537360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.537832] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.537832] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2347719f-c962-4b0a-9bb0-67fbda2a73fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.541854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.541854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.541854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.541854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.542087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.542087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26106805-0ecb-4f07-8e19-7d021437dbda" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.629276] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.629438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.629511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.629741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.666938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.667192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.667343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.667422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.667635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.667758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.667994] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 940.719433] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.719622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.719731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.720090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.720309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.731234] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 941.008264] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 941.008264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.008264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.008264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.008264] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.008264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.008968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.008968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.008968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.008968] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.015501] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.040328] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.040613] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.040790] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.041202] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.041386] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.041579] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 2347719f-c962-4b0a-9bb0-67fbda2a73fb not found, creating... [ 941.042018] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.042441] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.042615] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.042887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.043010] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.043375] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.043595] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.043745] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.044009] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.044268] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.044424] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 2347719f-c962-4b0a-9bb0-67fbda2a73fb is going to be created. [ 941.066753] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.066979] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.067092] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.067408] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.067644] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.067906] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.511279] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.511630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.511807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.512189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.512396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.512736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.512932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.513227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.513706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.513904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.514110] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be updated. [ 941.521633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.521934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.522091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.522432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.522571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.522704] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c is going to be created. [ 941.554742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.554944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.555096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.555283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.555491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.570863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: IN_PROGRESS for 2s [ 941.573086] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.573292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.573508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.573948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.574141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.587823] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: UNINITIALIZED for 2s [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d1d45c6-f0fc-4e81-bff9-011d7f3ae07f req-e753553d-a246-42aa-a889-cf446e0e1761 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d1d45c6-f0fc-4e81-bff9-011d7f3ae07f req-e753553d-a246-42aa-a889-cf446e0e1761 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d1d45c6-f0fc-4e81-bff9-011d7f3ae07f req-e753553d-a246-42aa-a889-cf446e0e1761 service nova] Enqueued Resource ID: 2347719f-c962-4b0a-9bb0-67fbda2a73fb with Priority: HIGHEST for action port [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 941.825046] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2347719f-c962-4b0a-9bb0-67fbda2a73fb with Priority: HIGHEST for action port [ 941.825046] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.825046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.825046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.825046] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.825742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.826023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2347719f-c962-4b0a-9bb0-67fbda2a73fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.826131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.826249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.826365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.826438] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2347719f-c962-4b0a-9bb0-67fbda2a73fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.150143] env[65222]: INFO networking_nsxv3.common.synchronization [req-8cd0be73-4cc7-4a53-bac5-72c9dfb799f3 req-fd33ccbe-a41e-4e96-aca7-8c6ffa3aca9b tempest-ServerDiagnosticsTest-591766268 tempest-ServerDiagnosticsTest-591766268-project-member] Enqueued Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 942.150830] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGHEST for action security_group_members [ 942.151180] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.151315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.151384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.151650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.151922] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.152032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.152076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.152262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.152349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.152449] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.328022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.328258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.328384] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2347719f-c962-4b0a-9bb0-67fbda2a73fb with status ACTIVE [ 942.328592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.328702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.328747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.328940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.329034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.329291] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.329403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.329818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.329818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.329818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.329964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.330054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.330100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.330291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.330366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.330448] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2347719f-c962-4b0a-9bb0-67fbda2a73fb is going to be updated. [ 942.355743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.355915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.355957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.356194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.356425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.356598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2347719f-c962-4b0a-9bb0-67fbda2a73fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.656024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.656267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.656341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.656572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.656666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.656912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.657021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.657115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.657239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.657340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.657435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39045f59-5600-413e-a6df-437146897c8f is going to be updated. [ 942.692905] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.693069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.693268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.694282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.694282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.706577] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: IN_PROGRESS for 2s [ 942.743877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 942.744217] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 deletion is rescheduled due to dependency. [ 942.744331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.744724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.745070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.745413] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.745704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.745704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.746106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.746244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.746478] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.049485] env[65222]: INFO networking_nsxv3.common.synchronization [req-b2fe0aea-5f28-4d9b-b477-6fb541ea4658 req-4166ec47-c286-4903-ab51-325c0adc1e30 tempest-ServersWithSpecificFlavorTestJSON-1341959581 tempest-ServersWithSpecificFlavorTestJSON-1341959581-project-member] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 943.050082] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGHEST for action security_group_members [ 943.050396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.050523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.050586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.051266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.051506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.051661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.051754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.051962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.052100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.052253] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.248442] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.555525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.555525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.555525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.555971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.556730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.556730] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.556946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.557045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.557349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.557487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.557646] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be updated. [ 943.581216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c156d898-0c95-428d-be52-aca57ef2133f in Status: SUCCESS [ 943.581422] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c156d898-0c95-428d-be52-aca57ef2133f deletion is rescheduled due to dependency. [ 943.581552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.597837] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.598021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.598062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.598627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.598627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.601515] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: SUCCESS [ 943.601728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.601905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.602153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.602347] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.602464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.602536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.602726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.602812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.602902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.602997] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.607099] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: IN_PROGRESS for 2s [ 943.752514] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.107281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.107476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.107652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.107747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.107891] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.107995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.108061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.108215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.108307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.108395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.108543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.108651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.108727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.108932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.109123] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.109422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.109422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.109565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.109680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.109825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.109968] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.257112] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.257112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.257112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.257112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.257112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.257112] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 944.311999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.312259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.312386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.312580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.312848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.325776] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 944.614410] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d779a56-b08e-4d96-a298-035aff7f597c: rpc.has_security_group_logging(os_id): False [ 944.640876] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.641088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.641088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.641403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.641495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.642060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.642238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.642671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.642671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.642671] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.642985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.643164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.643308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.643601] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.643838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.643838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.644877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.644877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.644877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c is going to be created. [ 944.718127] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39045f59-5600-413e-a6df-437146897c8f in Status: SUCCESS [ 944.718942] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39045f59-5600-413e-a6df-437146897c8f deletion is rescheduled due to dependency. [ 944.718942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.721647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.724019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.724019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.724019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.724019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.745864] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: IN_PROGRESS for 2s [ 944.842149] env[65222]: INFO networking_nsxv3.common.synchronization [req-18567caf-dd13-40ce-acb9-703d53c5b353 req-192308c7-79c0-4a0d-9e55-3ad2019cb7b9 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 944.842810] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 944.844309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.844309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.844309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.844835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.844835] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.347131] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.347448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.347448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.347593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.347669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.347874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.347977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.348051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.348239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.348294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.348380] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 945.379773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.380131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.380247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.380416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.380687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.389953] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 945.620289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 in Status: SUCCESS [ 945.620962] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 deletion is rescheduled due to dependency. [ 945.620962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.337085] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 946.337320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.338438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.338649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.340158] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.340400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.340474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.340700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.340759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.340868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.340951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.419846] env[65222]: INFO networking_nsxv3.common.synchronization [None req-8e66edc6-89ee-4ad7-bc0c-1d1af9cf412a tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 946.420395] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 946.420740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.420877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.421230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.421317] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.523819] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d32f9d10-872b-4273-ad48-2aa92e1809e0 tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 946.523919] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 946.524554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.524554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.759207] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: SUCCESS [ 946.759467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.848830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.848973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.849071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.849326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.849503] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.849605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.849670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.849829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.849917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.850027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.850178] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.850273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.850334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.850474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.850610] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.850702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.850763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.850895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.850971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.851063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.851163] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.945650] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.945823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.945899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.946147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.946243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.946348] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309c514b-b141-440e-916b-43a229296f1d already deleted. [ 946.946603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.946603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.947739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.947739] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.353758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8b0390-6b22-4e1a-92fa-1046e5b93e83: rpc.has_security_group_logging(os_id): False [ 947.376507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.376715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.376774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.377025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.377125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.377369] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.377486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.377553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.377729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.377824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.378012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.378128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.378190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.378330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.378425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.378669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.378779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.378873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.379023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.379100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.380575] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 947.398861] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 947.399066] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 947.399176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.455947] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.456305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.456305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.456483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.456657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.471045] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 947.472017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.472215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.472310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.472528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.472616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.472731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309c514b-b141-440e-916b-43a229296f1d already deleted. [ 947.472832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.471790] env[65222]: INFO networking_nsxv3.common.synchronization [None req-8e5188cb-e365-4c46-bbfa-e4b815eff214 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 948.471790] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 948.471790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.471790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.471790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.471790] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.973203] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.477253] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.487391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 949.487648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.980816] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.980816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.980816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.980816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.980816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.980816] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 950.019877] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.019877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.019877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.019877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.019877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.029740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 951.370029] env[65222]: INFO networking_nsxv3.common.synchronization [req-bfad123e-7e80-4762-a94a-47778d92a9f3 req-2949ac4d-335e-494c-b6b0-aea0dd28bef6 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 951.370029] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 951.370029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.370029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.370029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.370029] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.737138] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.737827] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.738118] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.738511] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.738889] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.739207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.739355] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.739676] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.739919] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.740235] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.740431] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.740859] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.741305] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.742047] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.742357] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.742675] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.772159] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.772649] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.772918] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.773290] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.773783] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-a930e8cc-c946-43b3-bfb9-9c39add0add6 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.774528] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.774868] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776668] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776974] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a930e8cc-c946-43b3-bfb9-9c39add0add6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.872541] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.042740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 952.042963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.283726] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.283962] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.284854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.284854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.285027] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.285116] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port a930e8cc-c946-43b3-bfb9-9c39add0add6 not found, creating... [ 952.285390] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.285626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.286041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.286041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.286136] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.286372] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.287442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.287442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.287442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.287442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.287618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: a930e8cc-c946-43b3-bfb9-9c39add0add6 is going to be created. [ 952.311464] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.311697] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.314645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.314645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.314791] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.314969] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.375546] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.879828] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.880027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.880078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.880293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.880389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.880491] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 952.923637] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.923838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.923877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.924992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.925270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.937999] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 953.051972] env[65222]: INFO networking_nsxv3.common.synchronization [req-132179e6-cedf-45c9-9006-9bd8bbf996b2 req-e4f50f85-64be-4b25-b3e0-324606e68012 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 953.052170] env[65222]: INFO networking_nsxv3.common.synchronization [req-132179e6-cedf-45c9-9006-9bd8bbf996b2 req-e4f50f85-64be-4b25-b3e0-324606e68012 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 953.052341] env[65222]: INFO networking_nsxv3.common.synchronization [req-132179e6-cedf-45c9-9006-9bd8bbf996b2 req-e4f50f85-64be-4b25-b3e0-324606e68012 service nova] Enqueued Resource ID: a930e8cc-c946-43b3-bfb9-9c39add0add6 with Priority: HIGHEST for action port [ 953.052830] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 953.052963] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 953.053137] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a930e8cc-c946-43b3-bfb9-9c39add0add6 with Priority: HIGHEST for action port [ 953.053459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.054248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.054337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.054599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.054688] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.056648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.056648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.056740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.056886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.057048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.057208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.057208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.057444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.057444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.057526] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.058450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a930e8cc-c946-43b3-bfb9-9c39add0add6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.058559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.058649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.058945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.058945] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a930e8cc-c946-43b3-bfb9-9c39add0add6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.229511] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d8fd342e-ceaf-4b86-8d37-59e60d940fd2 None None] Enqueued Resource ID: c1cb10a5-041a-4620-b58a-a10b568a7d9f with Priority: HIGHEST for action port [ 953.229998] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1cb10a5-041a-4620-b58a-a10b568a7d9f with Priority: HIGHEST for action port [ 953.230702] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1cb10a5-041a-4620-b58a-a10b568a7d9f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.230702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1cb10a5-041a-4620-b58a-a10b568a7d9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.230702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1cb10a5-041a-4620-b58a-a10b568a7d9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.231322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1cb10a5-041a-4620-b58a-a10b568a7d9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.231322] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cb10a5-041a-4620-b58a-a10b568a7d9f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.562870] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.562870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.562870] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.563914] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a930e8cc-c946-43b3-bfb9-9c39add0add6 with status ACTIVE [ 953.564391] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.564705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.564881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.565181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.566049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.566375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.567393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.567393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.567932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.568110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.568351] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a930e8cc-c946-43b3-bfb9-9c39add0add6 is going to be updated. [ 953.592162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.593307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.593307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.593307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.593307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.593307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a930e8cc-c946-43b3-bfb9-9c39add0add6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.733981] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1cb10a5-041a-4620-b58a-a10b568a7d9f [ 953.734110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.734181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.734230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.734457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.734583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.734716] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1cb10a5-041a-4620-b58a-a10b568a7d9f already deleted. [ 953.734763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1cb10a5-041a-4620-b58a-a10b568a7d9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.064637] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.568748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.569110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.569683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.569683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.569683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.570412] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 954.682110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.682255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.682255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.682563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.682770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.699707] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 954.949749] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 954.950032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.400159] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d4322a6c-52ab-49da-ab84-045bf53c1fe7 None None] Enqueued Resource ID: c75d8580-11b9-4a25-836c-0077a206aa5f with Priority: HIGHEST for action port [ 955.400159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75d8580-11b9-4a25-836c-0077a206aa5f with Priority: HIGHEST for action port [ 955.400159] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c75d8580-11b9-4a25-836c-0077a206aa5f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.400159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c75d8580-11b9-4a25-836c-0077a206aa5f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.402282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c75d8580-11b9-4a25-836c-0077a206aa5f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.402282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c75d8580-11b9-4a25-836c-0077a206aa5f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.402282] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c75d8580-11b9-4a25-836c-0077a206aa5f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.778383] env[65222]: INFO networking_nsxv3.common.synchronization [req-1bd9b4ce-a843-4fb8-9fd2-849c633e70d1 req-2fb8f28e-08ab-4e2c-987b-785af34f8987 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 955.781540] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 955.782313] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.782502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.782636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.783903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.784204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.784204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.784398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.784655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.784655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.784655] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.854286] env[65222]: INFO networking_nsxv3.common.synchronization [None req-057eaf83-0a9a-4e57-9649-aa426c82be7b None None] Enqueued Resource ID: c54a3153-f69b-4c97-8e29-6129bbd7b8fd with Priority: HIGHEST for action port [ 955.854286] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54a3153-f69b-4c97-8e29-6129bbd7b8fd with Priority: HIGHEST for action port [ 955.855445] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54a3153-f69b-4c97-8e29-6129bbd7b8fd taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.855760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54a3153-f69b-4c97-8e29-6129bbd7b8fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.855957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54a3153-f69b-4c97-8e29-6129bbd7b8fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.856326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54a3153-f69b-4c97-8e29-6129bbd7b8fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.856554] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54a3153-f69b-4c97-8e29-6129bbd7b8fd',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.904155] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c75d8580-11b9-4a25-836c-0077a206aa5f [ 955.904371] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.904618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.904618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.904827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.904939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.905091] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c75d8580-11b9-4a25-836c-0077a206aa5f already deleted. [ 955.905186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c75d8580-11b9-4a25-836c-0077a206aa5f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.197325] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.197516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.197637] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.197969] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.199126] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.199126] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.199126] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.199126] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.199126] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.199126] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.199433] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.199433] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.199500] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.199553] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.199654] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.200424] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.220809] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.221419] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.221419] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.221519] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.222556] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-1ca0a57b-0cb0-440e-a6b2-439da806c310 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.222556] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.222794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.224102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.224102] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ca0a57b-0cb0-440e-a6b2-439da806c310',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.288265] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.288489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.288489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.288739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.288833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.289060] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.289188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.289307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.289524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.289594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.290761] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc already deleted. [ 956.290761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.362216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c54a3153-f69b-4c97-8e29-6129bbd7b8fd [ 956.362491] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.362659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.362735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.362987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.363101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.363219] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c54a3153-f69b-4c97-8e29-6129bbd7b8fd already deleted. [ 956.363292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54a3153-f69b-4c97-8e29-6129bbd7b8fd" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.711670] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 956.711901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.712128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.712383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.712666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.712800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.712882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.713068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.713166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.713254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.713346] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.725907] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.726236] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.726422] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.726823] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.727430] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.727992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 1ca0a57b-0cb0-440e-a6b2-439da806c310 not found, creating... [ 956.728384] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.728648] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.728928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.729258] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.729443] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.730041] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.730287] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.730490] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.730766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.730961] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.731209] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 1ca0a57b-0cb0-440e-a6b2-439da806c310 is going to be created. [ 956.753800] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.754032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.754158] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.754437] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.754663] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.754996] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.218171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.218171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.218171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.218171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.218171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.218171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.218171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.218699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.218699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.218844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.219198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.219711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.219711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.219711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.219836] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.222284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.222284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.222796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.222796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.222796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.222796] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.456889] env[65222]: INFO networking_nsxv3.common.synchronization [None req-61de3352-3baf-4634-a58b-fbabd5ba4336 None None] Enqueued Resource ID: a2678cbd-8303-4081-8e6c-901d767dfecb with Priority: HIGHEST for action port [ 957.457487] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2678cbd-8303-4081-8e6c-901d767dfecb with Priority: HIGHEST for action port [ 957.457846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2678cbd-8303-4081-8e6c-901d767dfecb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.457988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2678cbd-8303-4081-8e6c-901d767dfecb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.458101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2678cbd-8303-4081-8e6c-901d767dfecb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.458485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2678cbd-8303-4081-8e6c-901d767dfecb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.458626] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2678cbd-8303-4081-8e6c-901d767dfecb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.486506] env[65222]: INFO networking_nsxv3.common.synchronization [req-1bd9b4ce-a843-4fb8-9fd2-849c633e70d1 req-b3f941ef-bffa-41d8-aabe-f592e384f9aa service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 957.486506] env[65222]: INFO networking_nsxv3.common.synchronization [req-1bd9b4ce-a843-4fb8-9fd2-849c633e70d1 req-b3f941ef-bffa-41d8-aabe-f592e384f9aa service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 957.486506] env[65222]: INFO networking_nsxv3.common.synchronization [req-1bd9b4ce-a843-4fb8-9fd2-849c633e70d1 req-b3f941ef-bffa-41d8-aabe-f592e384f9aa service nova] Enqueued Resource ID: 1ca0a57b-0cb0-440e-a6b2-439da806c310 with Priority: HIGHEST for action port [ 957.487022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 957.487291] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 957.487414] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca0a57b-0cb0-440e-a6b2-439da806c310 with Priority: HIGHEST for action port [ 957.487699] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.487822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.487885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.488387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.488494] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.489401] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.489591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.489657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.490113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.490113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.490113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.490261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.490302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.490402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.493642] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.495292] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ca0a57b-0cb0-440e-a6b2-439da806c310 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.495292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.495292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.495488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.495524] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ca0a57b-0cb0-440e-a6b2-439da806c310',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.725223] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8b0390-6b22-4e1a-92fa-1046e5b93e83: rpc.has_security_group_logging(os_id): False [ 957.745074] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.745295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.745295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.745806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.745806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.745998] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.745998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.746114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.746265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.746364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.746574] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.746800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.746800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.746950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.746950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.747224] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.747327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.747394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.747522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.747722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.747722] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 957.793035] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d3dc8ace-a28a-4ec0-8b38-1c378ed38a0c None None] Enqueued Resource ID: 23111001-5081-4380-b9e3-27667a92fd1c with Priority: HIGHEST for action port [ 957.793388] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23111001-5081-4380-b9e3-27667a92fd1c with Priority: HIGHEST for action port [ 957.793697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-23111001-5081-4380-b9e3-27667a92fd1c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.793818] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23111001-5081-4380-b9e3-27667a92fd1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.793883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23111001-5081-4380-b9e3-27667a92fd1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.794327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23111001-5081-4380-b9e3-27667a92fd1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.794421] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23111001-5081-4380-b9e3-27667a92fd1c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.816221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.816371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.816432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.818032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.818032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.832800] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 957.968498] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2678cbd-8303-4081-8e6c-901d767dfecb [ 957.968875] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.969174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.969301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.969533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.969686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.970548] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2678cbd-8303-4081-8e6c-901d767dfecb already deleted. [ 957.970548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2678cbd-8303-4081-8e6c-901d767dfecb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.999072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.999072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.999072] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.001673] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ca0a57b-0cb0-440e-a6b2-439da806c310 with status ACTIVE [ 958.002069] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.002069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.002196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.002314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.002407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.002587] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.002691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.002754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.002916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.002991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.003210] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.003306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.003370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.003508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.003598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.003657] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ca0a57b-0cb0-440e-a6b2-439da806c310 is going to be updated. [ 958.027305] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.027813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.027813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.027813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.027959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.028167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ca0a57b-0cb0-440e-a6b2-439da806c310" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.296627] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23111001-5081-4380-b9e3-27667a92fd1c [ 958.296985] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.296985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.297124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.297294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.297383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.297477] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23111001-5081-4380-b9e3-27667a92fd1c already deleted. [ 958.297562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23111001-5081-4380-b9e3-27667a92fd1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.504434] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.008840] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.008840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.008840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.008840] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be created. [ 959.038664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.039028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.039028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.039584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.039708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.051880] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: UNINITIALIZED for 2s [ 959.840019] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b8d11693-f99f-4604-9852-9b88bbf9818b None None] Enqueued Resource ID: 0ee77d82-2eac-45e2-ba62-65ca73e88708 with Priority: HIGHEST for action port [ 959.840637] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee77d82-2eac-45e2-ba62-65ca73e88708 with Priority: HIGHEST for action port [ 959.840990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ee77d82-2eac-45e2-ba62-65ca73e88708 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.841166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ee77d82-2eac-45e2-ba62-65ca73e88708" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.841216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ee77d82-2eac-45e2-ba62-65ca73e88708" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.841565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ee77d82-2eac-45e2-ba62-65ca73e88708" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.841938] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ee77d82-2eac-45e2-ba62-65ca73e88708',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.854287] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 959.854512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.343777] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ee77d82-2eac-45e2-ba62-65ca73e88708 [ 960.344032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.344152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.344221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.344434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.344522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.344615] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ee77d82-2eac-45e2-ba62-65ca73e88708 already deleted. [ 960.344697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ee77d82-2eac-45e2-ba62-65ca73e88708" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.064011] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 961.064351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.064507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.064754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.064989] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.065152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.065245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.065411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.065496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.065584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.065691] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.200407] env[65222]: INFO networking_nsxv3.common.synchronization [req-504042cd-aa64-4534-9a3c-4045b2f05a5f req-ac19a403-5ddf-43b2-9d9d-15c0ed59ddf1 tempest-SecurityGroupRulesNegativeTestJSON-32435388 tempest-SecurityGroupRulesNegativeTestJSON-32435388-project-member] Enqueued Resource ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 with Priority: HIGHEST for action security_group_rules [ 961.200977] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 with Priority: HIGHEST for action security_group_rules [ 961.201321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-774649f5-b3da-4cc9-834d-9ddffa824d10 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.201463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.202595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.202595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.202595] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('774649f5-b3da-4cc9-834d-9ddffa824d10',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.570088] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.570258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.570317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.570546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.570716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.570817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.570880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.571064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.571154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.571281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.571450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.571548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.571608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.571751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.571889] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.571980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.572053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.572192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.572268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.572370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.572474] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.722876] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.723118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.723296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.723805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.723965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.724119] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 already deleted. [ 961.724949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.077282] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 962.098969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.099460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.099460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.099620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.099620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.099877] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.099984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.099984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.100583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.100583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.100583] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.100583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.100583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.100879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.100879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.100935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.101022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.101076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.101721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.101721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.101721] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be created. [ 962.164724] env[65222]: INFO networking_nsxv3.common.synchronization [req-9dcd1efb-eb6e-4cb2-abc1-e5e01e8e1b48 req-8bfafb89-fe0f-470e-9755-2e1e31837043 tempest-ServerGroupTestJSON-1437184414 tempest-ServerGroupTestJSON-1437184414-project-member] Enqueued Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 962.165290] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGHEST for action security_group_members [ 962.166997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.167153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.167220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.167469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.167669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.167777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.167872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.168015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.168104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.168200] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.185089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.185312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.185312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.185543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.185741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.200517] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 962.675026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.675026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.675026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.675405] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c is going to be updated. [ 962.708687] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.708914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.708914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.709193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.709344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.720724] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: IN_PROGRESS for 2s [ 962.894704] env[65222]: INFO networking_nsxv3.common.synchronization [req-afea9b61-1d8a-4c28-bc40-e5c173af6fdb req-7cba863f-e4b5-4d14-b6bb-a56b37777228 tempest-SecurityGroupRulesNegativeTestJSON-32435388 tempest-SecurityGroupRulesNegativeTestJSON-32435388-project-member] Enqueued Resource ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 with Priority: HIGHEST for action security_group_rules [ 962.896051] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 with Priority: HIGHEST for action security_group_rules [ 962.896051] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-774649f5-b3da-4cc9-834d-9ddffa824d10 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.896051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.896051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.896051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.896320] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('774649f5-b3da-4cc9-834d-9ddffa824d10',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.422817] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.423140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.423140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.423298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.423380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.424019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 774649f5-b3da-4cc9-834d-9ddffa824d10 already deleted. [ 963.424019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-774649f5-b3da-4cc9-834d-9ddffa824d10" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.216647] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 964.217084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.735266] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d779a56-b08e-4d96-a298-035aff7f597c in Status: SUCCESS [ 964.735266] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c deletion is rescheduled due to dependency. [ 964.735266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.897282] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 967.897634] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 968.280065] env[65222]: INFO networking_nsxv3.common.synchronization [req-4adee19b-0e59-4be4-9525-38d3bb0a1a83 req-8ab02667-4f82-411b-8217-896681c09593 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 968.280328] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 968.281231] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.281231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.281231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.281896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.282495] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.282495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.282495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.283024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.283024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.283024] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.713815] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.714040] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.714169] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.714465] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.714782] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.714892] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.714993] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.715235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.715376] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.715587] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.715698] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.715805] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.715911] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.716037] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.716159] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.716286] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.738550] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.738661] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.738805] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.738991] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-566" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.739375] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-4643e5ad-fedc-41fd-937c-e575ed03c230 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.739610] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.739739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.740092] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.740277] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4643e5ad-fedc-41fd-937c-e575ed03c230',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.787189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.787453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.787568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.787886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.788060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.788366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.788524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.788634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.788827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.788911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.789008] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 968.840463] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.840696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.840696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.840853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.840997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.852382] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 969.242226] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.242697] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.242776] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.243082] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.243246] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.243415] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 4643e5ad-fedc-41fd-937c-e575ed03c230 not found, creating... [ 969.243727] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.243889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.244012] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.244253] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.244415] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.244693] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.244855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.244971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.245221] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.245353] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.245489] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 4643e5ad-fedc-41fd-937c-e575ed03c230 is going to be created. [ 969.266912] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.267164] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.267265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.267523] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.267745] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.268015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.970331] env[65222]: INFO networking_nsxv3.common.synchronization [req-4adee19b-0e59-4be4-9525-38d3bb0a1a83 req-c7bdd445-c3f1-4de9-8f99-c703a619eff2 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 969.970552] env[65222]: INFO networking_nsxv3.common.synchronization [req-4adee19b-0e59-4be4-9525-38d3bb0a1a83 req-c7bdd445-c3f1-4de9-8f99-c703a619eff2 service nova] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 969.970752] env[65222]: INFO networking_nsxv3.common.synchronization [req-4adee19b-0e59-4be4-9525-38d3bb0a1a83 req-c7bdd445-c3f1-4de9-8f99-c703a619eff2 service nova] Enqueued Resource ID: 4643e5ad-fedc-41fd-937c-e575ed03c230 with Priority: HIGHEST for action port [ 969.971778] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_rules [ 969.971778] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 969.971858] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4643e5ad-fedc-41fd-937c-e575ed03c230 with Priority: HIGHEST for action port [ 969.972193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.974439] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.974439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.974439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4643e5ad-fedc-41fd-937c-e575ed03c230 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.974439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.975036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.975088] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4643e5ad-fedc-41fd-937c-e575ed03c230',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.436350] env[65222]: INFO networking_nsxv3.common.synchronization [None req-9f99b4f3-abc1-44ce-a976-50c60372694e None None] Enqueued Resource ID: fbb15342-a53a-435f-a611-32b862234909 with Priority: HIGHEST for action port [ 970.436837] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb15342-a53a-435f-a611-32b862234909 with Priority: HIGHEST for action port [ 970.437151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb15342-a53a-435f-a611-32b862234909 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.437282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb15342-a53a-435f-a611-32b862234909" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.437357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb15342-a53a-435f-a611-32b862234909" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.437590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb15342-a53a-435f-a611-32b862234909" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.437670] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb15342-a53a-435f-a611-32b862234909',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.480723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.480723] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4643e5ad-fedc-41fd-937c-e575ed03c230 with status ACTIVE [ 970.480723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.480723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.480723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.480723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.481250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.481250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.482094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.482094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.482094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4643e5ad-fedc-41fd-937c-e575ed03c230 is going to be updated. [ 970.523119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.523119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.523119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.523119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.523119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.523535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4643e5ad-fedc-41fd-937c-e575ed03c230" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.866240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 970.866435] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 970.866555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.866725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.867810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.867810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.867810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.867810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.867810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.867810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.867810] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.942200] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbb15342-a53a-435f-a611-32b862234909 [ 970.942457] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.942595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.942668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.943456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.943562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.943670] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbb15342-a53a-435f-a611-32b862234909 already deleted. [ 970.943757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb15342-a53a-435f-a611-32b862234909" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.370259] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.409966] env[65222]: INFO networking_nsxv3.common.synchronization [req-d037870c-93bb-44da-94eb-1dff18f55063 req-7d4a1172-0b67-42a7-85fb-2e54b93be670 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 971.410632] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 971.410966] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.411473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.411580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.411828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.412045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.412205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.412301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.412502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.412618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.412733] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.582279] env[65222]: INFO networking_nsxv3.common.synchronization [None req-16157ce6-60a8-43b0-9ed0-91c447510dd9 tempest-ServerActionsV293TestJSON-1187284705 tempest-ServerActionsV293TestJSON-1187284705-project-member] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 971.582836] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 971.583146] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.583273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.583338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.583605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.583690] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.727455] env[65222]: INFO networking_nsxv3.common.synchronization [None req-44d7cd22-f1cf-41ee-9e4e-f469bb3c284e tempest-ServerActionsV293TestJSON-1187284705 tempest-ServerActionsV293TestJSON-1187284705-project-member] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 971.727455] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 971.727455] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.727455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.875033] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.918128] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.108251] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.111495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.111495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.112516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.112516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.113137] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 already deleted. [ 972.113137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.113286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.113499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.113594] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.274848] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f29f45f0-f1ed-4a73-b120-e9cef8d893e6 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 972.275492] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 972.275866] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.276000] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.378139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.378368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.378479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.379291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.379291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.379291] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 972.415296] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.416802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.416802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.416957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.418136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.419270] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.433781] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 972.637301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.637301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.638383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.638383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.638383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.638383] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 already deleted. [ 972.638383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.789068] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a4ad2ab9-d241-4364-95b8-2342e357ea13 None None] Enqueued Resource ID: df683b47-ae8b-46b6-aaee-506339c1b8af with Priority: HIGHEST for action port [ 972.791490] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df683b47-ae8b-46b6-aaee-506339c1b8af with Priority: HIGHEST for action port [ 972.792031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-df683b47-ae8b-46b6-aaee-506339c1b8af taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.792121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df683b47-ae8b-46b6-aaee-506339c1b8af" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.792247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df683b47-ae8b-46b6-aaee-506339c1b8af" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.792967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df683b47-ae8b-46b6-aaee-506339c1b8af" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.793276] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df683b47-ae8b-46b6-aaee-506339c1b8af',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.925056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.925245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.925300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.925519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.925755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.925755] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 972.965188] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.965335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.965406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.965717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.965914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.978095] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 973.296696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df683b47-ae8b-46b6-aaee-506339c1b8af [ 973.296696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.296696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.296696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.296696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.298700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.298700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df683b47-ae8b-46b6-aaee-506339c1b8af already deleted. [ 973.298700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df683b47-ae8b-46b6-aaee-506339c1b8af" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.697525] env[65222]: INFO networking_nsxv3.common.synchronization [req-0b0d333f-1d72-4c46-ac48-347bad860373 req-afd67f3b-6014-4458-8e15-0ac307921a2a tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 973.698080] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 973.698397] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.698519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.698585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.698854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.699026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.699133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.699195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.699350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.699532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.699631] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.197902] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.198180] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.198409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.198812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.200151] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.200151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.200151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.200151] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.200369] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.200476] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.200584] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.200716] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.200897] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.201110] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.201343] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.201604] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.203576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.203722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.203967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.204060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.204190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.204485] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.204645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.204759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.205024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.205127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.205265] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309c514b-b141-440e-916b-43a229296f1d already deleted. [ 974.205397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.224376] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.224376] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.224510] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.224679] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-76" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.224995] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.225187] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.225296] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.225633] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.225766] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.452323] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.452323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.452323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.452323] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.729444] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.729766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.729766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.730021] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.730060] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.730202] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac not found, creating... [ 974.730572] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.730778] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.730898] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.731167] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.731304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.731666] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.731826] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.731943] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.732347] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.733579] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.733997] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac is going to be created. [ 974.782046] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.783014] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.783014] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.783175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.783521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.783901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.954964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.955349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.955349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.955533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.955676] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.955973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.955973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.956092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.956092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.956178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.956334] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.956430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.956493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.956639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.956781] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.956875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.956942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.957201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.957282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.957370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.957490] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.994538] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 974.994766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.994954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.995216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.995611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.995611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.995611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.995847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.995894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.996015] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.443776] env[65222]: INFO networking_nsxv3.common.synchronization [req-0b0d333f-1d72-4c46-ac48-347bad860373 req-00cb4700-1087-405f-8a83-62cef5ca9f94 service nova] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 975.443934] env[65222]: INFO networking_nsxv3.common.synchronization [req-0b0d333f-1d72-4c46-ac48-347bad860373 req-00cb4700-1087-405f-8a83-62cef5ca9f94 service nova] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 975.444071] env[65222]: INFO networking_nsxv3.common.synchronization [req-0b0d333f-1d72-4c46-ac48-347bad860373 req-00cb4700-1087-405f-8a83-62cef5ca9f94 service nova] Enqueued Resource ID: e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac with Priority: HIGHEST for action port [ 975.444570] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_rules [ 975.444716] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 975.444813] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac with Priority: HIGHEST for action port [ 975.445570] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.445705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.445796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.446043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.446249] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.450321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.450321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.450321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.450321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.451281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.451422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.451529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.451712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.451769] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.461833] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bedc55f5-0ad2-4b84-aab1-d26ca6737e7a: rpc.has_security_group_logging(os_id): False [ 975.486289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.488288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.488288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.488288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.488694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.488694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.488809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.488943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.489044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.489250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.489359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.489491] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 975.502402] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.502402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.502402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.502630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.502630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.502820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.502892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.502892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.503071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.503137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.503222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 975.531985] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.532171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.532242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.532472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.532602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.543938] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 975.569443] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.569595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.569637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.569844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.569975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.587825] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 975.953600] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.953600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.954937] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac with status ACTIVE [ 975.955147] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.955306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.955363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.955541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.955628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.955801] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.955898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.955957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.956377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.956458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.956649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.956756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.956801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.956931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.957018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.957116] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac is going to be updated. [ 975.958271] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.987879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.988085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.988126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.988318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.988510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.988852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a643b2-7c93-4db3-b9a4-db1e6f8b3dac" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.461102] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.966333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.966333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.966333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.966333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.966333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.966333] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309c514b-b141-440e-916b-43a229296f1d is going to be created. [ 977.006759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.006921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.006985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.007207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.007370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.020420] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: UNINITIALIZED for 2s [ 977.252686] env[65222]: INFO networking_nsxv3.common.synchronization [req-403b9aa4-9e4f-4ccc-a1d3-baa71b567342 req-6ef6c5a4-a813-487a-a760-c1653e1e00b2 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 977.253177] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGHEST for action security_group_members [ 977.253484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.253606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.253670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.253882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.254253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.254369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.254434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.254606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.254692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.254785] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.555061] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 977.555228] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 deletion is rescheduled due to dependency. [ 977.555543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.604282] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 977.605327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.757114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.757501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.757501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.757725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.757886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.759014] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.759227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.759227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.759486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.759580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.759712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7d31cf-9989-4765-9a76-058b268adcef is going to be updated. [ 977.820207] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.820207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.820207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.820207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.820207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.830934] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: IN_PROGRESS for 2s [ 979.037075] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: SUCCESS [ 979.037423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.037526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.037788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.038010] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.038134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.038230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.038552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.038552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.038676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.038743] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.055454] env[65222]: INFO networking_nsxv3.common.synchronization [req-53763c7d-eae7-40d9-abb2-7c7d021f2398 req-9e3e546f-7a36-4b1f-83f3-df40e6d1e648 tempest-ServerMetadataNegativeTestJSON-2120457382 tempest-ServerMetadataNegativeTestJSON-2120457382-project-member] Enqueued Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 979.055962] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 979.056378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.056617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.056617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.056731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.056961] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.057231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.057302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.057499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.057573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.057633] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.524480] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-4 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.524688] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.524867] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.525279] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.525626] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.525846] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.525992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.526292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.526476] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.526724] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.526864] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.526996] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.527184] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.527288] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.527399] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.527540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.541799] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.560155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.560352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.560352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.560515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.560606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.560841] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.560957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.561049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.561226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.561304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.561394] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 already deleted. [ 979.561516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.581289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.581504] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.581652] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.581855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-4" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.582225] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-70aa0386-0a80-4791-ba67-374d35110dc1 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.582471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.582822] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.583229] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.583453] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70aa0386-0a80-4791-ba67-374d35110dc1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.843319] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7d31cf-9989-4765-9a76-058b268adcef in Status: SUCCESS [ 979.843915] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7d31cf-9989-4765-9a76-058b268adcef deletion is rescheduled due to dependency. [ 979.844065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.044821] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 309c514b-b141-440e-916b-43a229296f1d: rpc.has_security_group_logging(os_id): False [ 980.075921] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.076118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.076217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.076489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.076623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.076951] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.077080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.077129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.077297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.077396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.077498] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309c514b-b141-440e-916b-43a229296f1d is going to be created. [ 980.085631] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.085850] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.085973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.086265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.086409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.086563] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 70aa0386-0a80-4791-ba67-374d35110dc1 not found, creating... [ 980.086822] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.086976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.087108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.087333] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.087467] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.087776] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.087942] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.088069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.088290] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.088412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.088554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 70aa0386-0a80-4791-ba67-374d35110dc1 is going to be created. [ 980.108931] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.109140] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.109235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.109653] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.109853] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.110013] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.145348] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.145348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.145466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.145590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.145776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.164230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: IN_PROGRESS for 2s [ 980.288596] env[65222]: INFO networking_nsxv3.common.synchronization [None req-87c0fbcc-b877-45dd-8035-c180f5cdae87 None None] Enqueued Resource ID: 2138d37f-804e-40c9-9323-c4282f283cc5 with Priority: HIGHEST for action port [ 980.289239] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2138d37f-804e-40c9-9323-c4282f283cc5 with Priority: HIGHEST for action port [ 980.289619] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2138d37f-804e-40c9-9323-c4282f283cc5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.289619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2138d37f-804e-40c9-9323-c4282f283cc5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.289619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2138d37f-804e-40c9-9323-c4282f283cc5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.290286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2138d37f-804e-40c9-9323-c4282f283cc5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.290286] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2138d37f-804e-40c9-9323-c4282f283cc5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.792818] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2138d37f-804e-40c9-9323-c4282f283cc5 [ 980.793168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.793258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.793298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.793594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.793673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.793803] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2138d37f-804e-40c9-9323-c4282f283cc5 already deleted. [ 980.793906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2138d37f-804e-40c9-9323-c4282f283cc5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.814431] env[65222]: INFO networking_nsxv3.common.synchronization [req-53763c7d-eae7-40d9-abb2-7c7d021f2398 req-00461fc0-738d-4321-a979-d68a0bcdd75f service nova] Enqueued Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_rules [ 980.814431] env[65222]: INFO networking_nsxv3.common.synchronization [req-53763c7d-eae7-40d9-abb2-7c7d021f2398 req-00461fc0-738d-4321-a979-d68a0bcdd75f service nova] Enqueued Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 980.814431] env[65222]: INFO networking_nsxv3.common.synchronization [req-53763c7d-eae7-40d9-abb2-7c7d021f2398 req-00461fc0-738d-4321-a979-d68a0bcdd75f service nova] Enqueued Resource ID: 70aa0386-0a80-4791-ba67-374d35110dc1 with Priority: HIGHEST for action port [ 980.814431] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_rules [ 980.814431] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 980.814609] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70aa0386-0a80-4791-ba67-374d35110dc1 with Priority: HIGHEST for action port [ 980.815320] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.815320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.815320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.815320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.815320] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.816297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.816369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.816455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.817776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.817776] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.817776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.817776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.817776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.817776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.817776] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.820079] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-70aa0386-0a80-4791-ba67-374d35110dc1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.820187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.820260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.820423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.820499] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70aa0386-0a80-4791-ba67-374d35110dc1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.056835] env[65222]: INFO networking_nsxv3.common.synchronization [req-852c3c4e-d07b-4753-b7bf-460fe31ee191 req-dd5cc917-a65e-46c9-b47a-58bbb800c44d tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 981.057135] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 981.057825] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.057825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.057825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058879] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.320701] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.321928] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.322054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.322503] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70aa0386-0a80-4791-ba67-374d35110dc1 with status ACTIVE [ 981.322753] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.324505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.324505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.324505] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.325129] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70aa0386-0a80-4791-ba67-374d35110dc1 is going to be updated. [ 981.355466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.355632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.355701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.355954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.356111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.356284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70aa0386-0a80-4791-ba67-374d35110dc1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.564222] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.824273] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.926272] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.926272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.926272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.926749] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.927234] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.927560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.927820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.928235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.928516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.928841] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.929116] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.929423] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.929672] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.929960] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.931019] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.931019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.952318] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.952318] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.952318] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.952318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-467" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.952318] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-48408075-62ca-4c7a-a830-7c8cfc8e92fb taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.952318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.952318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.952318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.952318] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48408075-62ca-4c7a-a830-7c8cfc8e92fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.066567] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.180241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: SUCCESS [ 982.180872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.327387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.328018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.328018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.328018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.328018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.328018] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 is going to be created. [ 982.455311] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.455441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.455481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.455696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.455855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.458030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.458030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.458030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.458030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.458030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.458030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.458313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.458313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.458502] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.458635] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.459341] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.459341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.459341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.459534] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.459585] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.459697] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb is going to be updated. [ 982.470733] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: UNINITIALIZED for 2s [ 982.483551] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.483791] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.483907] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.484207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.484405] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.485316] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.571593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.571793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.571828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.572056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.572155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.572258] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 982.613263] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.613744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.613744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.613744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.613890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.637630] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 982.919105] env[65222]: INFO networking_nsxv3.common.synchronization [None req-168b0271-b136-41f7-9fc0-b7e5aef51d4f None None] Enqueued Resource ID: c6043187-f89e-4b46-b86d-15a952b5e08d with Priority: HIGHEST for action port [ 982.919870] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6043187-f89e-4b46-b86d-15a952b5e08d with Priority: HIGHEST for action port [ 982.920501] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6043187-f89e-4b46-b86d-15a952b5e08d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.920662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6043187-f89e-4b46-b86d-15a952b5e08d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.920764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6043187-f89e-4b46-b86d-15a952b5e08d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.921392] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6043187-f89e-4b46-b86d-15a952b5e08d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.921392] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6043187-f89e-4b46-b86d-15a952b5e08d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.288427] env[65222]: INFO networking_nsxv3.common.synchronization [req-e68465ea-ac48-44e0-9ce0-739efc656698 req-12035b9f-4ae0-4ae2-a3a7-de56e4ba8376 service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 983.288731] env[65222]: INFO networking_nsxv3.common.synchronization [req-e68465ea-ac48-44e0-9ce0-739efc656698 req-12035b9f-4ae0-4ae2-a3a7-de56e4ba8376 service nova] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 983.288881] env[65222]: INFO networking_nsxv3.common.synchronization [req-e68465ea-ac48-44e0-9ce0-739efc656698 req-12035b9f-4ae0-4ae2-a3a7-de56e4ba8376 service nova] Enqueued Resource ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb with Priority: HIGHEST for action port [ 983.289750] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_rules [ 983.290544] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 983.290544] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb with Priority: HIGHEST for action port [ 983.290544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.290544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.290843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.290843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.290907] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.292212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.292500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.292500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.292603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.293301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.293301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.293301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.293301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.293301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.293576] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.295276] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-48408075-62ca-4c7a-a830-7c8cfc8e92fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.295276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.295407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.296080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.296080] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48408075-62ca-4c7a-a830-7c8cfc8e92fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.423871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6043187-f89e-4b46-b86d-15a952b5e08d [ 983.424118] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.424248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.424354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.424518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.424607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.424704] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6043187-f89e-4b46-b86d-15a952b5e08d already deleted. [ 983.424786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6043187-f89e-4b46-b86d-15a952b5e08d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.798272] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.798932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.798932] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.800144] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48408075-62ca-4c7a-a830-7c8cfc8e92fb with status ACTIVE [ 983.800362] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.800499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.800571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.800802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.800985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.801120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.801262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.801356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.801589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.801678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.801892] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.802478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.802478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.802478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.802478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.802478] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48408075-62ca-4c7a-a830-7c8cfc8e92fb is going to be updated. [ 983.827898] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.827898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.828119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.828992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.828992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.828992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48408075-62ca-4c7a-a830-7c8cfc8e92fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.306102] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.483202] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: SUCCESS [ 984.483456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.483646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.483905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.485075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.485075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.485075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.485075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.485075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.485075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.485075] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.651676] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 984.651676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.814072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.814298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.814390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.814782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.815067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.815228] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 984.877403] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.877670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.877736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.878041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.878251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.889242] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 984.990441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.990619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.990698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.990917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.991107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.991205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.991292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.991560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.991560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.991691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.991820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.991915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.991975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.992143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.992286] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.992412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.992456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.992616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.992691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.992768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.992855] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.495564] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82be25be-b943-41e8-a603-dee27a20c6f9: rpc.has_security_group_logging(os_id): False [ 985.515695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.516019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.516019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.516170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.516264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.516482] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.516578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.516644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.517077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.517077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.517213] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.517213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.517293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.517401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.517476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.517719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.517837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.517894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.518057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.518198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.518301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 is going to be created. [ 985.596708] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.596996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.597090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.597480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.597816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.610955] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: IN_PROGRESS for 2s [ 986.903568] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 986.903953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.905286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.905592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.905794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.905952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.906063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.906287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.906373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.906576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.906576] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.409240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.409486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.409622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.409875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.410158] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.410316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.410369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.410659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.410659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.410789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.410932] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.411101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.411214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.411387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.411576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.411725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.411799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.411972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.412204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.412320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.412433] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.632325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: SUCCESS [ 987.632560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.915012] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef0e22a7-af6f-4355-8779-ca32518594be: rpc.has_security_group_logging(os_id): False [ 987.936325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.936474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.936546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.936765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.936850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.937087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.937182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.937243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.937421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.937578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.937981] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.937981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.937981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.937981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.938218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.938218] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.938367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.938367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.938510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.938610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.938680] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 988.049591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.049812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.049812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.050018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.050191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.068355] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 988.292385] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 988.292487] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 988.538075] env[65222]: INFO networking_nsxv3.common.synchronization [req-ca4cfbe6-a724-4803-8567-7f5de330a39e req-dfc514d8-f041-468b-b5da-655eb6ee8b1a tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 988.538752] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 988.539240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.539366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.539566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.539852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.540085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.540206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.540296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.540491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.540615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.540735] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.039479] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.040019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.040209] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.040599] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.040917] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.042019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.042019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.042019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.042019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.042315] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.042315] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.042450] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.042657] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.042839] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.043402] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.043603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.045316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.045451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.045510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.046176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.046324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.047359] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.047359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.047359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.047359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.047359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.047741] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 already deleted. [ 989.047741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.070288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.070420] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.070566] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.070742] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.072528] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-feaef159-8d21-448d-a48d-fafb26a69c79 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.072528] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.072528] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.072832] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.072832] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feaef159-8d21-448d-a48d-fafb26a69c79',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.577713] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.577926] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.578102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.578405] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.578611] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.578762] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port feaef159-8d21-448d-a48d-fafb26a69c79 not found, creating... [ 989.579059] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.579265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.579382] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.579645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.579807] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.580143] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.580322] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.580448] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.580656] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.580786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.580928] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: feaef159-8d21-448d-a48d-fafb26a69c79 is going to be created. [ 989.642330] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.642758] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.643213] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.643784] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.644067] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.644725] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.084221] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 990.084518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.360345] env[65222]: INFO networking_nsxv3.common.synchronization [req-ca4cfbe6-a724-4803-8567-7f5de330a39e req-7dc125b5-75aa-4b3f-b57c-b8fb1d989c51 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 990.360527] env[65222]: INFO networking_nsxv3.common.synchronization [req-ca4cfbe6-a724-4803-8567-7f5de330a39e req-7dc125b5-75aa-4b3f-b57c-b8fb1d989c51 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 990.360661] env[65222]: INFO networking_nsxv3.common.synchronization [req-ca4cfbe6-a724-4803-8567-7f5de330a39e req-7dc125b5-75aa-4b3f-b57c-b8fb1d989c51 service nova] Enqueued Resource ID: feaef159-8d21-448d-a48d-fafb26a69c79 with Priority: HIGHEST for action port [ 990.361225] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 990.361361] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 990.361461] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaef159-8d21-448d-a48d-fafb26a69c79 with Priority: HIGHEST for action port [ 990.361788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.361933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.361965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.362257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.362342] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.365122] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.365262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.365323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.366262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.366262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.366262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.366262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.366262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.366262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.366262] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.367602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-feaef159-8d21-448d-a48d-fafb26a69c79 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.367602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.367602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.367602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.367602] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feaef159-8d21-448d-a48d-fafb26a69c79',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.870279] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.870518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.870592] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.871674] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feaef159-8d21-448d-a48d-fafb26a69c79 with status ACTIVE [ 990.871874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.871994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.872201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.872496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.872663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.872854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.872965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.873058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.873271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.873354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.873552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.873648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.873725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.873885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.873972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.874084] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feaef159-8d21-448d-a48d-fafb26a69c79 is going to be updated. [ 990.896365] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.896540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.896588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.896799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.897110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.897110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feaef159-8d21-448d-a48d-fafb26a69c79" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.376269] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.632015] env[65222]: INFO networking_nsxv3.common.synchronization [req-29212116-41e4-4425-8e77-f49044bf29b2 req-3c77eaa1-64fd-4a6e-8807-3f569885cd4e tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 991.632015] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 991.632143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.632246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.632307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.632594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.632671] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.632820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.632820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.632982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.634432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.634432] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.881257] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.881521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.881741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.881985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.882100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.882214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be created. [ 991.916387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.916620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.916714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.916954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.918509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.931766] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: UNINITIALIZED for 2s [ 992.137634] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.137634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.137634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.137875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.138097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138210] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.138311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.138397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.138495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.138565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 992.173379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.173622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.173729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.174385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.174385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.185122] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 993.268338] env[65222]: INFO networking_nsxv3.common.synchronization [req-da7a52db-914f-4dce-9e28-059cef31e514 req-55dd5acf-3423-443b-bf10-18db3ba1b803 tempest-ServerMetadataNegativeTestJSON-2120457382 tempest-ServerMetadataNegativeTestJSON-2120457382-project-member] Enqueued Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 993.269639] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGHEST for action security_group_members [ 993.269639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.269639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.269789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.269915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.270051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.270118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.270277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.270362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.270455] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.621600] env[65222]: INFO networking_nsxv3.common.synchronization [req-394d7a11-2bbb-41f1-abb9-cbf7e60b2c68 req-69afc098-79a2-4ee3-bd2b-50d334822df0 tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 993.622181] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 993.623011] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.623011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.772284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.772484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.772546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.773039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.773162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.773513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.773691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.773754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.773995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.774141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.774426] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 is going to be updated. [ 993.820251] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.820450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.820450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.820661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.821372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.834355] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: IN_PROGRESS for 2s [ 993.947909] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 993.948154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.948515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.948623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.948850] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.949033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.949033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.949215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.949298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.949386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.949514] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.950417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.950618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.950774] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.950916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.950974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.951120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.951203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.951306] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.019640] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.019863] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.019977] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.020322] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.020603] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.020704] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.020836] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.021032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.021517] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.021517] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.021517] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.021782] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.021782] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.021782] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.021893] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.022022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.042734] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.042935] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.043075] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.043247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.043547] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-5215d523-c66a-4570-8605-25770b5062f1 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.043719] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.043832] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.044243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.044385] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5215d523-c66a-4570-8605-25770b5062f1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.196300] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 994.196814] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 994.196814] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.453830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.454364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.454364] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.547768] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.548324] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.548629] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.549168] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.549554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.549816] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 5215d523-c66a-4570-8605-25770b5062f1 not found, creating... [ 994.550373] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.550703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.550967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.551439] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.551751] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.552395] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.552737] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.552971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.553428] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.553725] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.554057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 5215d523-c66a-4570-8605-25770b5062f1 is going to be created. [ 994.580961] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.581280] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.581444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.581856] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.582124] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.582398] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.956194] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.401158] env[65222]: INFO networking_nsxv3.common.synchronization [req-394d7a11-2bbb-41f1-abb9-cbf7e60b2c68 req-5c5473a6-4e7a-476d-9d55-e366da760709 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 995.401158] env[65222]: INFO networking_nsxv3.common.synchronization [req-394d7a11-2bbb-41f1-abb9-cbf7e60b2c68 req-5c5473a6-4e7a-476d-9d55-e366da760709 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 995.401158] env[65222]: INFO networking_nsxv3.common.synchronization [req-394d7a11-2bbb-41f1-abb9-cbf7e60b2c68 req-5c5473a6-4e7a-476d-9d55-e366da760709 service nova] Enqueued Resource ID: 5215d523-c66a-4570-8605-25770b5062f1 with Priority: HIGHEST for action port [ 995.402128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 995.402128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 995.402128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5215d523-c66a-4570-8605-25770b5062f1 with Priority: HIGHEST for action port [ 995.402851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.402851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.403189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.403323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.403536] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5215d523-c66a-4570-8605-25770b5062f1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.403643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.403736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.403939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.404035] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5215d523-c66a-4570-8605-25770b5062f1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.459208] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.459902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.459902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.459902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.459902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.460198] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 995.492390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.492678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.492856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.493081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.493232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.504404] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 995.844011] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82be25be-b943-41e8-a603-dee27a20c6f9 in Status: SUCCESS [ 995.844209] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 deletion is rescheduled due to dependency. [ 995.844318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.909016] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5215d523-c66a-4570-8605-25770b5062f1 with status ACTIVE [ 995.909277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.909427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.909497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.909757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.909857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.910056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.910160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.910225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.910384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.910459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.910648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.910732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.910795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.910936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.911093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.911150] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5215d523-c66a-4570-8605-25770b5062f1 is going to be updated. [ 996.026760] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.026933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.026981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.027195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.027336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.027498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5215d523-c66a-4570-8605-25770b5062f1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.318975] env[65222]: INFO networking_nsxv3.common.synchronization [req-089a511b-edef-4484-9374-b647ddd03bb3 req-db4fdef2-4cf4-4c99-b1d5-507cddabae22 tempest-ImagesTestJSON-1464606202 tempest-ImagesTestJSON-1464606202-project-member] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 996.319668] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGHEST for action security_group_members [ 996.319932] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.320071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.320150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.320362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.320525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.321121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.321195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.321386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.321484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.321590] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.824075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.824423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.824423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.824567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.824621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.824809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.824903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.824961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.825133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.825206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.825295] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be updated. [ 996.862953] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.863156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.863250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.863483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.863626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.873689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: IN_PROGRESS for 2s [ 997.517599] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 997.517599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.517599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.517864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.518061] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.518190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.518236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.518399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.518491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.518786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.519026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.519099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.519156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.519325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.519459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.519587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.519719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.519875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.519949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.520051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.520138] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.521201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.521289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.521427] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.521885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.521885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.523096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.523096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.523096] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.024390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3611c6f7-c786-4748-b4fa-faf7bcfceab1: rpc.has_security_group_logging(os_id): False [ 998.025615] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.046494] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.046690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.046778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.047031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.047159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.047427] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.047627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.047627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.047801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.047952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.048107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.048237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.048322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.048467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.048654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.048783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.048901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.049106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.049190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.049264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.049903] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be created. [ 998.123693] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.123949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.123949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.124279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.124475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.140898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 998.529513] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.887715] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a in Status: SUCCESS [ 998.887925] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a deletion is rescheduled due to dependency. [ 998.888091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.031794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.032354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.032354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.032354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.032354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.032558] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 999.079939] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.079939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.079939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.079939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.079939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.095137] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 999.205088] env[65222]: INFO networking_nsxv3.common.synchronization [None req-7a280a7b-b46b-4d12-875e-08a49f0bc512 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 with Priority: HIGHEST for action security_group_rules [ 999.205704] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 with Priority: HIGHEST for action security_group_rules [ 999.207467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fe23cad-5bd9-4790-8c6f-9006af069a33 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.207467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.207467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.207467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.207467] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fe23cad-5bd9-4790-8c6f-9006af069a33',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.303391] env[65222]: INFO networking_nsxv3.common.synchronization [None req-1c2cd284-3b06-4f21-8205-77c79523902d tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 with Priority: HIGHEST for action security_group_rules [ 999.303956] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 with Priority: HIGHEST for action security_group_rules [ 999.304277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fe23cad-5bd9-4790-8c6f-9006af069a33 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.304363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.744057] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.744057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 already deleted. [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.744057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.744057] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fe23cad-5bd9-4790-8c6f-9006af069a33',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.164017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1000.164407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.164519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.165179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.165179] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.270487] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.271076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.271195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.271802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.271909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.272079] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fe23cad-5bd9-4790-8c6f-9006af069a33 already deleted. [ 1000.272140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fe23cad-5bd9-4790-8c6f-9006af069a33" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.667848] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.668084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.105914] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1001.105914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.105914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.105914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.105914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.105914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.106329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.106329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.106329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.106518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.106590] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.609030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.609369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.609369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.609470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.609687] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.609844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.609844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.610084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.610084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.610272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.610272] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.610387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.610436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.610561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.610688] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.610859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.610859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.610958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.611046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.611114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.611217] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.744129] env[65222]: INFO networking_nsxv3.common.synchronization [req-7e1cec4c-da26-4d0a-b2a9-cb3845771a1c req-c1e6e339-edc0-41cd-956f-e49fa4f1c018 tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1001.744703] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1001.745017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.745785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.745785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.745785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.745785] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.746155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.746155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.746155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.746155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.746289] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.058501] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.058696] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.058847] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.059179] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.059488] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.059691] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.059832] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.061156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.061406] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.061639] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.061791] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.061910] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.062034] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.062149] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.062255] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.062393] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.089483] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.089483] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.089680] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.089865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-781" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.090209] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.090376] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.090771] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.090920] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.091059] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae6643e-edb3-45d5-bce6-b0a5dc34835c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.115369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3611c6f7-c786-4748-b4fa-faf7bcfceab1: rpc.has_security_group_logging(os_id): False [ 1002.136516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.136516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.136516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.136746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.137152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.137152] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.137310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.137310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.137492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.137617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.138245] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.138245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.138245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.138245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.138445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.138641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.138641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.138942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.138942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.139026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.139112] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1002.215947] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.216104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.216158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.216352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.216501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.233803] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1002.248984] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.502518] env[65222]: INFO networking_nsxv3.common.synchronization [req-fc1d4b6c-b5e8-44f3-b2c1-0633f2554fff req-af0037e3-437e-4f3d-8385-3374d553010d tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1002.503712] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1002.504117] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.504248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.504324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.504528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.504678] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.504792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.505457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.505699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.505806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.505939] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.593523] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.593873] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.594055] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.594373] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.595101] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.595300] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 6ae6643e-edb3-45d5-bce6-b0a5dc34835c not found, creating... [ 1002.595629] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.595796] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.596318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.596318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.596318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.596928] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.596928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.596928] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.597212] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.597355] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.597527] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 6ae6643e-edb3-45d5-bce6-b0a5dc34835c is going to be created. [ 1002.629952] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.629952] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.629952] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.630444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.630444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.630527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.751287] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.008816] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.008956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.008956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.009171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.009298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.009472] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.009585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.009679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.009822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.010237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.010237] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1003.050404] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.050563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.050606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.050821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.050959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.062575] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1003.257036] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.257036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.257036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.257036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.257036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.257036] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1003.298940] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.298940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.298940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.299414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.299414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.310575] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1003.372423] env[65222]: INFO networking_nsxv3.common.synchronization [req-7e1cec4c-da26-4d0a-b2a9-cb3845771a1c req-bd3d3bd5-00d4-4e13-a81c-56e935fd1ae8 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 1003.372590] env[65222]: INFO networking_nsxv3.common.synchronization [req-7e1cec4c-da26-4d0a-b2a9-cb3845771a1c req-bd3d3bd5-00d4-4e13-a81c-56e935fd1ae8 service nova] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1003.372720] env[65222]: INFO networking_nsxv3.common.synchronization [req-7e1cec4c-da26-4d0a-b2a9-cb3845771a1c req-bd3d3bd5-00d4-4e13-a81c-56e935fd1ae8 service nova] Enqueued Resource ID: 6ae6643e-edb3-45d5-bce6-b0a5dc34835c with Priority: HIGHEST for action port [ 1003.373929] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_rules [ 1003.373929] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1003.374224] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae6643e-edb3-45d5-bce6-b0a5dc34835c with Priority: HIGHEST for action port [ 1003.374563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.374652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.375023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.375113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.375305] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.375419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.375459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.375666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.375739] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae6643e-edb3-45d5-bce6-b0a5dc34835c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.878969] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ae6643e-edb3-45d5-bce6-b0a5dc34835c with status ACTIVE [ 1003.878969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.878969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.878969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.878969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.878969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.878969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.880947] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.880947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.880947] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ae6643e-edb3-45d5-bce6-b0a5dc34835c is going to be updated. [ 1003.913304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.913304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.913304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.913497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.913497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.913696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae6643e-edb3-45d5-bce6-b0a5dc34835c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.149054] env[65222]: INFO networking_nsxv3.common.synchronization [req-7c01f6dc-628a-4bbd-a902-51ec3873caf3 req-cea00d38-a43c-448f-bd11-6757c392326e tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1004.149717] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1004.149811] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.149916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.149978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.150837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.150837] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.150837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.150837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.150837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.151009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.151009] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.268963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1004.269220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.269395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.269720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.269818] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.500809] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.500809] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.501013] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.501231] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.501485] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.501642] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.501816] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.502485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.502485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.502485] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.502602] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.502688] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.502820] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.502924] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.503317] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.503317] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.526040] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.526188] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.526431] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.526720] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.527219] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-45ec0104-2701-4dcc-bbd8-387260bce397 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.527518] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.527754] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.528824] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.528824] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ec0104-2701-4dcc-bbd8-387260bce397',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.653369] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.772610] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.772796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.032904] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.033323] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.033323] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.033587] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.033734] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.033895] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 45ec0104-2701-4dcc-bbd8-387260bce397 not found, creating... [ 1005.034201] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.034359] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.034474] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.034697] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.034832] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.035137] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.035292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.035405] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.035609] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.035739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.035876] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 45ec0104-2701-4dcc-bbd8-387260bce397 is going to be created. [ 1005.058046] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.058046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.058046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.058046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.058046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.058046] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.072252] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1005.072441] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 1005.072538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.155113] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.321858] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1005.321858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.322019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.322267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.322474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.322769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.322921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.323240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323240] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.657249] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.657521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.657521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.658253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.658253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.658253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1005.693547] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.693696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.693819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.694135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.694862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.704822] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1005.780685] env[65222]: INFO networking_nsxv3.common.synchronization [req-7c01f6dc-628a-4bbd-a902-51ec3873caf3 req-9a24733d-9a42-499a-9fec-713b62836444 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1005.780783] env[65222]: INFO networking_nsxv3.common.synchronization [req-7c01f6dc-628a-4bbd-a902-51ec3873caf3 req-9a24733d-9a42-499a-9fec-713b62836444 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1005.780909] env[65222]: INFO networking_nsxv3.common.synchronization [req-7c01f6dc-628a-4bbd-a902-51ec3873caf3 req-9a24733d-9a42-499a-9fec-713b62836444 service nova] Enqueued Resource ID: 45ec0104-2701-4dcc-bbd8-387260bce397 with Priority: HIGHEST for action port [ 1005.781491] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1005.781635] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1005.781875] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ec0104-2701-4dcc-bbd8-387260bce397 with Priority: HIGHEST for action port [ 1005.782191] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.782317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.782380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.782581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.782676] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.783658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.783658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.783810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ec0104-2701-4dcc-bbd8-387260bce397 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.783896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.783949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.784130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.784193] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ec0104-2701-4dcc-bbd8-387260bce397',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.826443] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.286046] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.286367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.288725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45ec0104-2701-4dcc-bbd8-387260bce397 with status ACTIVE [ 1006.289068] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.289246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.289336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.289642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.289776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.290043] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.290180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.290293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.290551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.290675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.290876] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.291036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.291156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.291336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.291468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.291618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45ec0104-2701-4dcc-bbd8-387260bce397 is going to be updated. [ 1006.315240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.315389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.315510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.315669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.315807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.315966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ec0104-2701-4dcc-bbd8-387260bce397" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.328058] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.504920] env[65222]: INFO networking_nsxv3.common.synchronization [None req-043e3218-1667-4f0d-a2d6-1c07dfb21b39 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1006.506200] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1006.506200] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.506200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.507024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.507105] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.611014] env[65222]: INFO networking_nsxv3.common.synchronization [None req-230ff551-0b2f-4a8e-96de-33f9ec2dbf6d tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1006.611542] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1006.612048] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.612165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.830969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.830969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.830969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.831201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.831300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.831334] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1006.864533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.864694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.864815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.864990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.865159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.875232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1007.032155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.032332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.032332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.032701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.032852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.033081] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 already deleted. [ 1007.033215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.033413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.033624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.033774] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.556552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.556972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.556972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.557133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.557248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.557353] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 already deleted. [ 1007.557449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.717613] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1007.717965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.718208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.718470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.719042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.719042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.719042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.719262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.719262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.719363] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.222391] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.726988] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.889999] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1008.889999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.889999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.889999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.889999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.890228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.890228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.890364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.890445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.890536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.890626] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.229484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.229703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.229949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.230218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.230324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.230482] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1009.268650] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.268857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.268857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.269117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.269211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.280126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1009.393994] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.393994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.393994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.394276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.395156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.395156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.395156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.395725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.395725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.395725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.395725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.395725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.395927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.395927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.395927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.396038] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.900270] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3611c6f7-c786-4748-b4fa-faf7bcfceab1: rpc.has_security_group_logging(os_id): False [ 1009.925658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.925813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.925884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.926124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.926208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.926651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.926651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.926651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.926908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.926908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.927066] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.927168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.927229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.927373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.927448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.927641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.927767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.928298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.928298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.928298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.928298] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1010.048466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.048705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.048841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.049215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.049491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.066073] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1010.668540] env[65222]: INFO networking_nsxv3.common.synchronization [req-702dd06e-2591-4cc8-8a7f-eeea08569f13 req-65606a1d-9601-4429-a2f6-bb538574d2c2 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1010.672042] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1010.672858] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.672999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.673104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.673416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.673575] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.673677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.673739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.673897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.673969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.674093] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.923129] env[65222]: INFO networking_nsxv3.common.synchronization [req-986d34aa-9d5c-45e6-874b-8be05bd63038 req-f08d9532-20e4-4c5c-8c64-a4fa491eab26 tempest-ServersAdminTestJSON-1617299968 tempest-ServersAdminTestJSON-1617299968-project-member] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 1010.923886] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGHEST for action security_group_members [ 1010.925055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.925191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.925238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.925504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.925680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.925793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.925861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.926756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.927323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.927323] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.171988] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.172254] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.172403] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.172762] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.176024] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.176024] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.176024] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.176024] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.176024] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.176024] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.176024] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.176024] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.176024] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.176024] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.176024] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.176024] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.176900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.177060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.177212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.177446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.177637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.181023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.181023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e already deleted. [ 1011.181023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.202458] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.202630] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.202798] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.203252] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.203539] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-b0690562-0422-47aa-8522-94bc69e8fc72 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.203761] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.203893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.204309] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.204482] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0690562-0422-47aa-8522-94bc69e8fc72',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.293023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.293023] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.293023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.293975] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.435451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.435451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.435451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.435451] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be updated. [ 1011.470192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.470475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.470475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.470606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.470738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.487269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: IN_PROGRESS for 2s [ 1011.710211] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.710457] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.710606] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.710839] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.710992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.711230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port b0690562-0422-47aa-8522-94bc69e8fc72 not found, creating... [ 1011.711511] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.711671] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.711819] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.712079] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.712225] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.712518] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.712676] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.712810] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.713116] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.713261] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.713408] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: b0690562-0422-47aa-8522-94bc69e8fc72 is going to be created. [ 1011.742509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.742744] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.742876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.743139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.743682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.743682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.796751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.796931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.796971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.797225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.797411] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.797641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.797641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.797733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.797807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.797910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.798042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.798141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.798196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.798344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.798484] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.798585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.798648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.798764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.798841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.798925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.799028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.085404] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1012.085796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.301129] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1012.320047] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.320278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.320278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.320526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.320610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.320812] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.320937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.320937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.321095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.321169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.321431] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.321550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.321619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.321853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.321980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.322654] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.322946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.323056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.323205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.323303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.323401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1012.418123] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.418123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.418123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.418123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.418123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.434364] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1012.495030] env[65222]: INFO networking_nsxv3.common.synchronization [req-702dd06e-2591-4cc8-8a7f-eeea08569f13 req-d5eebf88-5a22-4e4b-bcfa-1fdf2a70a146 service nova] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1012.495030] env[65222]: INFO networking_nsxv3.common.synchronization [req-702dd06e-2591-4cc8-8a7f-eeea08569f13 req-d5eebf88-5a22-4e4b-bcfa-1fdf2a70a146 service nova] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1012.495030] env[65222]: INFO networking_nsxv3.common.synchronization [req-702dd06e-2591-4cc8-8a7f-eeea08569f13 req-d5eebf88-5a22-4e4b-bcfa-1fdf2a70a146 service nova] Enqueued Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1012.495430] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1012.495576] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1012.495675] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1012.495997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.496128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.496200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.496489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.496597] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.670517] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.670517] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.670517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.670517] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.670517] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0690562-0422-47aa-8522-94bc69e8fc72 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.671055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.671055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.671055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.671055] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0690562-0422-47aa-8522-94bc69e8fc72',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.021021] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1013.021491] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:2 started [ 1013.172794] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.173803] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.173945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.174083] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0690562-0422-47aa-8522-94bc69e8fc72 with status ACTIVE [ 1013.174287] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.175037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.175037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.175471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.175471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.175471] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.175626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.175626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.175716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.175760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.175847] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0690562-0422-47aa-8522-94bc69e8fc72 is going to be updated. [ 1013.201677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.201677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.201677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.201677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.201677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.201677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.404603] env[65222]: INFO networking_nsxv3.common.synchronization [req-193741ee-def9-48e7-8b41-bd03e8e19d5e req-871e1a8e-b7a9-47fd-bbb6-7e36169bd05d tempest-ServersAdminNegativeTestJSON-971697259 tempest-ServersAdminNegativeTestJSON-971697259-project-member] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1013.405175] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1013.405467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.405592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.405592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.405854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.406027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.406134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.406190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.406327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.406401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.406496] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.501113] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 in Status: SUCCESS [ 1013.501316] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 deletion is rescheduled due to dependency. [ 1013.501425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.678168] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.821847] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.822189] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.822441] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.824404] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.826491] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.826788] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.827009] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.827412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.827680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.828033] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.828251] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.828455] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.828653] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.828859] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.830063] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.830281] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.850804] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.850972] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.851157] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.851345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.851663] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-19669359-c8c1-4487-8805-b0efad3f55e8 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.851863] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.851985] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.852318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.852481] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19669359-c8c1-4487-8805-b0efad3f55e8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.911022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.911022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.911022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 already deleted. [ 1013.911022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.181057] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.181422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.181422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.181645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.181645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.181702] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be created. [ 1014.207736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.207904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.207978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.208201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.208588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.219546] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: UNINITIALIZED for 2s [ 1014.358491] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.358717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.358839] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.359150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.359303] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.359457] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 19669359-c8c1-4487-8805-b0efad3f55e8 not found, creating... [ 1014.359732] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.359913] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.360019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.360247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.360380] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.360662] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.360820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.360933] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.361152] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.361278] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.361411] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 19669359-c8c1-4487-8805-b0efad3f55e8 is going to be created. [ 1014.385111] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.385348] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.385471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.385754] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.385982] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.386220] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.449473] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1014.449721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [req-193741ee-def9-48e7-8b41-bd03e8e19d5e req-60552668-3bbd-4baf-9cc5-73777ff4a2f9 service nova] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_rules [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [req-193741ee-def9-48e7-8b41-bd03e8e19d5e req-60552668-3bbd-4baf-9cc5-73777ff4a2f9 service nova] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [req-193741ee-def9-48e7-8b41-bd03e8e19d5e req-60552668-3bbd-4baf-9cc5-73777ff4a2f9 service nova] Enqueued Resource ID: 19669359-c8c1-4487-8805-b0efad3f55e8 with Priority: HIGHEST for action port [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_rules [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1015.136020] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19669359-c8c1-4487-8805-b0efad3f55e8 with Priority: HIGHEST for action port [ 1015.136999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.137288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.137532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.137866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.138131] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.139349] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.141251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.141251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.141251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.141251] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.141251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.141251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.141906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.142119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.144765] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.144765] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-19669359-c8c1-4487-8805-b0efad3f55e8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.144765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.144765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.144765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.144765] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19669359-c8c1-4487-8805-b0efad3f55e8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.646170] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.646536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.646536] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.653611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19669359-c8c1-4487-8805-b0efad3f55e8 with status ACTIVE [ 1015.653611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.653611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.653611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.653611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.653611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19669359-c8c1-4487-8805-b0efad3f55e8 is going to be updated. [ 1015.674523] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.674960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.674960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.674960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.675157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.675298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19669359-c8c1-4487-8805-b0efad3f55e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.935101] env[65222]: INFO networking_nsxv3.common.synchronization [req-3eb47233-ed46-4a3b-bc5c-75ff4217182a req-b2d56a68-533f-46d4-87be-ee6ba924c778 tempest-ServerActionsV293TestJSON-1187284705 tempest-ServerActionsV293TestJSON-1187284705-project-member] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1015.935688] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1015.935995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.936133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.936200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.936745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.936970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.937172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.937172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.937542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.937676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.937825] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.149069] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.232174] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1016.232284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.232365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.232586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.233521] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.233521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.233521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.233521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.233521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.233521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.233521] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.320303] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.320538] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-927" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.320704] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-927" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.321112] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-927" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.321470] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.321667] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.321847] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.322118] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.322348] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.322612] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.322760] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.322945] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.323032] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.323184] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.323318] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.323472] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.343743] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.343929] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.344116] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.344272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-927" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.344594] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-e1605445-5775-4939-97b9-19b9ebe92018 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.344766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.344902] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.345247] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.345384] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1605445-5775-4939-97b9-19b9ebe92018',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.439744] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.439928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.439987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.440264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.440362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.440605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.440730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.440798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.440959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.441040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.441133] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 already deleted. [ 1016.441213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.652555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.652906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.652906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.653288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.653420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.653529] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be created. [ 1016.682585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.682834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.682834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.683051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.683221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.695435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: UNINITIALIZED for 2s [ 1016.736912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.736912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.736912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.737198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.737528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.737528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.737664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.737744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.737825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.737908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.738102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.738179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.738569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.738569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.738569] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.738672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.738672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.739131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.739131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.739131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.739131] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.848187] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.848736] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.848736] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.849064] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.849287] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.849508] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port e1605445-5775-4939-97b9-19b9ebe92018 not found, creating... [ 1016.849908] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.850155] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.850948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.850948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.850948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.851292] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.851527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.851707] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.852055] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.852277] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.852490] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: e1605445-5775-4939-97b9-19b9ebe92018 is going to be created. [ 1016.873599] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.873888] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.873970] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.874679] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.874679] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.875251] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.241599] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1017.262544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.262544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.262544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.262832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.262832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.262991] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.263124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.263220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.263501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.263501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.263677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.263816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.263816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.263962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.264102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.264337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.264432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.264499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.264633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.264704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.264804] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be created. [ 1017.373398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.373686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.373686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.373826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.374039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.394295] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1017.681613] env[65222]: INFO networking_nsxv3.common.synchronization [req-3eb47233-ed46-4a3b-bc5c-75ff4217182a req-b4fdc9ba-cd67-4532-8db1-2e6681a98718 service nova] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 1017.681937] env[65222]: INFO networking_nsxv3.common.synchronization [req-3eb47233-ed46-4a3b-bc5c-75ff4217182a req-b4fdc9ba-cd67-4532-8db1-2e6681a98718 service nova] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1017.682118] env[65222]: INFO networking_nsxv3.common.synchronization [req-3eb47233-ed46-4a3b-bc5c-75ff4217182a req-b4fdc9ba-cd67-4532-8db1-2e6681a98718 service nova] Enqueued Resource ID: e1605445-5775-4939-97b9-19b9ebe92018 with Priority: HIGHEST for action port [ 1017.682725] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_rules [ 1017.683116] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1017.685067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1605445-5775-4939-97b9-19b9ebe92018 with Priority: HIGHEST for action port [ 1017.685067] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.685067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.685067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.685067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.685067] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.685519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.685694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.685783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.686041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.686278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.686395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.686501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.686699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.686875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.687230] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.688055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1605445-5775-4939-97b9-19b9ebe92018 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.688190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.688301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.688516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.688632] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1605445-5775-4939-97b9-19b9ebe92018',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.191187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.191187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.191187] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.194125] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1605445-5775-4939-97b9-19b9ebe92018 with status ACTIVE [ 1018.194333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.195156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.195156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.195468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.195468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.195545] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.195595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.195639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.195742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.197582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.197582] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1605445-5775-4939-97b9-19b9ebe92018 is going to be updated. [ 1018.219043] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.219191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.219257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.219488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.219597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.219769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1605445-5775-4939-97b9-19b9ebe92018" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.451031] env[65222]: INFO networking_nsxv3.common.synchronization [req-f54afef8-38dd-4013-afef-8892c58507f2 req-5b857ecc-fc73-480d-b8b3-05c8a3abcb47 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1018.453126] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1018.453126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.453126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.453126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.454142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.454327] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.454437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.454500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.454678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.454879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.454879] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.697782] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.708712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.711024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.711024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.711024] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.958851] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.198726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.198889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.198962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.199201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.199328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.199444] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 is going to be created. [ 1019.215490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.215655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.215729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.215951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.216161] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.216265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.216330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.216489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.216598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.216711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.216866] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.216960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.217031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.217183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.217322] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.217412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.217472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.217607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.217682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.217761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.217849] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.228294] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.229350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.241199] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: UNINITIALIZED for 2s [ 1019.406697] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1019.406697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.461152] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.720434] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a055c4f3-b6b2-41d3-9478-9a1e5a156588: rpc.has_security_group_logging(os_id): False [ 1019.756574] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.756821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.756821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.757032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.757195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.757356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.757460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.757542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.757726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.757809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.758252] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.758252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.758252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.758604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.758604] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.758604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.758782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.758846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.758954] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be created. [ 1019.936988] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.936988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.936988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.936988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.936988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.967542] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.967542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.967542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.967542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.967542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.967542] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1019.989221] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1020.048093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.048093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.048323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.048358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.048510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.077924] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1020.493768] env[65222]: INFO networking_nsxv3.common.synchronization [req-2e2623fc-aaa7-4734-b667-ccd784e6babe req-c3240e65-c568-4f9f-beee-66c6dd95cd44 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1020.495077] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1020.495077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.495077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.495077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.495585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.495585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.495585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.495700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.497450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.497450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.497450] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.935028] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.935028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.935028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.935028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.935028] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.935028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.935028] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.935686] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.935918] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.936189] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.936308] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.936415] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.936520] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.936626] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.936727] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.936937] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.959141] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.959343] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.959465] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.959609] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.959986] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-854dd7fd-d565-408f-a6a4-240f2171ac2d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.960188] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.960307] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.960636] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.960769] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('854dd7fd-d565-408f-a6a4-240f2171ac2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.999200] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.999386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.999488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.999775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.999839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.000138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.000240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.000305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.000485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.000548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.000623] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1021.047120] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.047283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.047340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.047555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.047700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.058660] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1021.253240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: SUCCESS [ 1021.253514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.253773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.254120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.254422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.254589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.254662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.254825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.254907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.255029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.255187] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.410098] env[65222]: INFO networking_nsxv3.common.synchronization [req-65ed2372-fff1-4566-a372-16d2849c9e63 req-3ee54416-6020-4d28-bdb4-32b5b657b519 tempest-ServersNegativeTestJSON-2124253759 tempest-ServersNegativeTestJSON-2124253759-project-member] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 1021.410098] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGHEST for action security_group_members [ 1021.410098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.410098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.410098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.410098] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.463277] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.463277] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.463277] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.463570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.463570] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.463652] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 854dd7fd-d565-408f-a6a4-240f2171ac2d not found, creating... [ 1021.463917] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.464084] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.464199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.464417] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.464551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.464836] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.464991] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.465119] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.465318] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.465448] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.465585] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 854dd7fd-d565-408f-a6a4-240f2171ac2d is going to be created. [ 1021.487463] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.487673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.487823] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.488060] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.488289] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.488508] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.758042] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.912713] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.912938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.913052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.913280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.913372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.913591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.913730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.913822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.914036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.914123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.914239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be updated. [ 1021.955803] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.955803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.955803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.956217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.956217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.965633] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: IN_PROGRESS for 2s [ 1022.004710] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1022.004710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.093028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1022.093313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.224111] env[65222]: INFO networking_nsxv3.common.synchronization [req-2e2623fc-aaa7-4734-b667-ccd784e6babe req-429b675e-8492-4f02-8526-f6d5519beaac service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1022.224360] env[65222]: INFO networking_nsxv3.common.synchronization [req-2e2623fc-aaa7-4734-b667-ccd784e6babe req-429b675e-8492-4f02-8526-f6d5519beaac service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1022.224506] env[65222]: INFO networking_nsxv3.common.synchronization [req-2e2623fc-aaa7-4734-b667-ccd784e6babe req-429b675e-8492-4f02-8526-f6d5519beaac service nova] Enqueued Resource ID: 854dd7fd-d565-408f-a6a4-240f2171ac2d with Priority: HIGHEST for action port [ 1022.225517] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1022.225676] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1022.225908] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 854dd7fd-d565-408f-a6a4-240f2171ac2d with Priority: HIGHEST for action port [ 1022.226229] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.226398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.226489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.226868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.226990] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.228256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.228360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.228655] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-854dd7fd-d565-408f-a6a4-240f2171ac2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.228740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.228808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.228995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.229080] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('854dd7fd-d565-408f-a6a4-240f2171ac2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.260738] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5069f7f-5460-4aba-91e3-1ff69c00f601: rpc.has_security_group_logging(os_id): False [ 1022.279743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.279911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.280020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.280229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.280321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.280585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.280729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.280796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.281056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.281141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.281236] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 is going to be created. [ 1022.386138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.386348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.386446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.386673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.386906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.401093] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: IN_PROGRESS for 2s [ 1022.734264] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.734427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.734659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 854dd7fd-d565-408f-a6a4-240f2171ac2d with status ACTIVE [ 1022.734889] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.735018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.735086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.735351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.735461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.735676] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.735808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.735868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.736021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.736116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.736441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.736441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.736589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.736657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.736738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.736828] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 854dd7fd-d565-408f-a6a4-240f2171ac2d is going to be updated. [ 1022.761929] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.762097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.762143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.762335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.762470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.762632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-854dd7fd-d565-408f-a6a4-240f2171ac2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.072452] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1023.072855] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1023.073008] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.073294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.073566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.073763] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.073889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.073973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.074172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.074254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.074359] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.577140] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.978832] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef0e22a7-af6f-4355-8779-ca32518594be in Status: SUCCESS [ 1023.978832] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef0e22a7-af6f-4355-8779-ca32518594be deletion is rescheduled due to dependency. [ 1023.978832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.080406] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.417782] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: SUCCESS [ 1024.418153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.584262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.584479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.584549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.584771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.584855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.584960] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1024.621159] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.621324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.621495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.621648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.621831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.634735] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1024.971835] env[65222]: INFO networking_nsxv3.common.synchronization [req-f5b069e0-5aba-425b-a65c-f3f1b586d07f req-b9fb6a0d-f642-4b9a-b87a-d2c690a9d972 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1024.972512] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1024.973449] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.973636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.973717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.973919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.974139] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.974334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.974334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.974417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.974518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.974577] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.136864] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1025.136864] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1025.136864] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1025.137323] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1025.137323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.137323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.137618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.137618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.138287] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.138287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.138287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.138287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.138287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.138287] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.139712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.139891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.139974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.140235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.140516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.140516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.140649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.140739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.140833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.143084] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.196525] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1025.196710] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1025.196838] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_rules [ 1025.196969] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1025.197112] env[65222]: INFO networking_nsxv3.common.synchronization [req-0a9e0fb8-5c61-41c0-a661-7411bc45ed1f req-85751c78-8108-4769-9a68-d25cb5ab7236 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1025.197731] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1025.197800] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_rules [ 1025.197872] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1025.198074] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1025.198074] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1025.198397] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.198520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.198580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.198911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.198911] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.199808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.199890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.199928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.200193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.200310] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.201308] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0690562-0422-47aa-8522-94bc69e8fc72 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.201438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.201507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.201773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.201773] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0690562-0422-47aa-8522-94bc69e8fc72',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.205584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.205584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.205584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.205584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.436549] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.436744] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.436868] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.437250] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.437603] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.437813] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.437987] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.438259] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.438434] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.438684] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.438823] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.438970] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.439131] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.439286] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.439398] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.439554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.463743] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.463931] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.464101] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.464291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.464650] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-ca8e610c-db16-4640-9cde-014462814f8f taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.464886] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.464963] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.465365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.465535] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca8e610c-db16-4640-9cde-014462814f8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.476618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.476779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.476843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.477032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.477126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.477321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.477418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.477474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.477623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.477697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.477838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1025.511178] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.512195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.512195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.512195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.512195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.522932] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1025.644954] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.646164] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.704259] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.704415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.705435] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.705435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.708086] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0690562-0422-47aa-8522-94bc69e8fc72 with status ACTIVE [ 1025.708275] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.708392] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.708770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.708770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.708770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.709018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.709018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.709120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.709270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.709360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.709619] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.709736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.709918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.710051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.710176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.710381] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0690562-0422-47aa-8522-94bc69e8fc72 is going to be updated. [ 1025.734067] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.734288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.734288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.734676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.734676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.734884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.968712] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.968953] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.969095] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.969395] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.969544] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.969707] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port ca8e610c-db16-4640-9cde-014462814f8f not found, creating... [ 1025.969986] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.970153] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.970269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.970514] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.970651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.970933] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.971103] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.971226] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.971426] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.971559] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.971700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: ca8e610c-db16-4640-9cde-014462814f8f is going to be created. [ 1026.004059] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.004200] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.004378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.004664] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.004923] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.005202] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.148739] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.149321] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.649349] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1026.649720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.649859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.650204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.650525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.650648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.650723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.650904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.654162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.654407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.654534] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.655900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.656126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.656241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.656544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.656690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.656812] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1026.658213] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.658352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.658408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.658652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.658708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.658765] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be created. [ 1026.692700] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.692997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.692997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.693448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.693448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.697632] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.697861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.697861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.698073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.698307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.710934] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: UNINITIALIZED for 2s [ 1026.713028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1026.800021] env[65222]: INFO networking_nsxv3.common.synchronization [req-f5b069e0-5aba-425b-a65c-f3f1b586d07f req-2332a3f6-2672-461f-9023-5a212cd6a6dc service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 1026.800021] env[65222]: INFO networking_nsxv3.common.synchronization [req-f5b069e0-5aba-425b-a65c-f3f1b586d07f req-2332a3f6-2672-461f-9023-5a212cd6a6dc service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1026.800021] env[65222]: INFO networking_nsxv3.common.synchronization [req-f5b069e0-5aba-425b-a65c-f3f1b586d07f req-2332a3f6-2672-461f-9023-5a212cd6a6dc service nova] Enqueued Resource ID: ca8e610c-db16-4640-9cde-014462814f8f with Priority: HIGHEST for action port [ 1026.801132] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 1026.801325] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1026.801933] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8e610c-db16-4640-9cde-014462814f8f with Priority: HIGHEST for action port [ 1026.802075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.802549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.802684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.803019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.805441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.805441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.805441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.805441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca8e610c-db16-4640-9cde-014462814f8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.805441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.805441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.805441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.805441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca8e610c-db16-4640-9cde-014462814f8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.161173] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.164087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.164087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.164087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.164087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.166061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.166061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.166061] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.301134] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1027.301134] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1027.301134] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1027.301134] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1027.302114] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1027.302934] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1027.306030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.306030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.306030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.306030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.306030] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.306030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.307952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.309641] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca8e610c-db16-4640-9cde-014462814f8f with status ACTIVE [ 1027.309641] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.309641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.310051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.310378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.310612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.315028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.315028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.315028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.315028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca8e610c-db16-4640-9cde-014462814f8f is going to be updated. [ 1027.315974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.316137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.346680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.346865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.346907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.347150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.347314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.347492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca8e610c-db16-4640-9cde-014462814f8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.356233] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_rules [ 1027.356433] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1027.356579] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1027.356759] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1027.356856] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_rules [ 1027.357060] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [req-4d7827bc-591e-46e5-b0e6-2c9189e7daa8 req-990dd930-42a2-46a5-88d7-c8224a93fa94 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_rules [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0690562-0422-47aa-8522-94bc69e8fc72 with Priority: HIGHEST for action port [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_rules [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1027.363534] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1027.363534] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.363534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.363534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.363916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.363916] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.365591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.365591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.365591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.365591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.365844] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0690562-0422-47aa-8522-94bc69e8fc72 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.365844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.365844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.366085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.366976] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0690562-0422-47aa-8522-94bc69e8fc72',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.367878] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.368027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.368310] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.368310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.369092] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.369092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.536655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1027.539157] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.539157] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.539157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.539157] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.664765] env[65222]: INFO networking_nsxv3.common.synchronization [None req-758a94e6-34cc-422c-8841-889f4120b390 None None] Enqueued Resource ID: 1f5147c8-828b-4cd8-8813-385296574919 with Priority: HIGHEST for action port [ 1027.665626] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5147c8-828b-4cd8-8813-385296574919 with Priority: HIGHEST for action port [ 1027.665982] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f5147c8-828b-4cd8-8813-385296574919 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.666122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f5147c8-828b-4cd8-8813-385296574919" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.666207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f5147c8-828b-4cd8-8813-385296574919" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.666519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f5147c8-828b-4cd8-8813-385296574919" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.666519] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5147c8-828b-4cd8-8813-385296574919',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.667775] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 1027.689766] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.689979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.690089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.690402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.690631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.690732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.690792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.691053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.691360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.691479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.691558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.691706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.691783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.692032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.692179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.692228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.692352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.692425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.692514] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1027.722327] env[65222]: INFO networking_nsxv3.common.synchronization [req-eb39ea2e-7807-4114-bf0d-823dbbc3b6cc req-a05ad302-e947-40fe-9b45-ea487dfd9d1c tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1027.723444] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1027.724410] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.724410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.724410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.724410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.724681] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.724681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.724681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.724835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.725103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.725198] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.787662] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.787848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.787972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.788254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.788416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.805392] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1027.808270] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.869598] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0690562-0422-47aa-8522-94bc69e8fc72 with status ACTIVE [ 1027.869809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.869900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.870831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.870831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.870831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.870831] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.870831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.870831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.871207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.871207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.871301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.871394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.871687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.871687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.871687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.871865] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0690562-0422-47aa-8522-94bc69e8fc72 is going to be updated. [ 1027.873209] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.873356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.945240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.945571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.945571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.945571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.945731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.945904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0690562-0422-47aa-8522-94bc69e8fc72" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.046967] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.168653] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f5147c8-828b-4cd8-8813-385296574919 [ 1028.169026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.169026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.169139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.169445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.169559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.169659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f5147c8-828b-4cd8-8813-385296574919 already deleted. [ 1028.169742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f5147c8-828b-4cd8-8813-385296574919" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.227334] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.227537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.227537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.227760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.227853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.228092] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.228189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.228255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.228407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.228481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.228570] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 already deleted. [ 1028.228655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.313506] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.551467] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.670766] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.670766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.670766] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.670993] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.672444] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.672444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.672444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.672444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.672444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.672444] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.672444] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.672444] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.672944] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.672944] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.672944] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.672944] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.696103] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.696273] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.696415] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.696593] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.696912] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-0161ec30-f59f-4c00-ab27-7b89198f94f0 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.697147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.697342] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.697775] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.697939] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0161ec30-f59f-4c00-ab27-7b89198f94f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.734068] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1028.734370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.734668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.734988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.735188] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.735303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.735367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.735947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.735947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.735947] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.738011] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1028.738234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.738405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.738682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.738769] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.738981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.739132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.739336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.739436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.739534] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.820052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.820052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.820181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.820298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.820384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.820485] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be created. [ 1028.848469] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.848645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.848682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.848919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.849104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.895668] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: UNINITIALIZED for 2s [ 1029.056119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.056119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.056119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.056119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.056119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.056119] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1029.111621] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.111621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.111621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.111621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.111621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.140643] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1029.201761] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.202199] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.202264] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.202536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.202707] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.202876] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 0161ec30-f59f-4c00-ab27-7b89198f94f0 not found, creating... [ 1029.203248] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.203345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.203480] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.203731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.203887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.204225] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.204472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.204616] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.204849] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.205010] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.205167] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 0161ec30-f59f-4c00-ab27-7b89198f94f0 is going to be created. [ 1029.229849] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.230162] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.230308] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.230596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.230842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.231100] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.241826] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.242903] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.656028] env[65222]: INFO networking_nsxv3.common.synchronization [None req-57adeb03-aa66-46dd-873b-901719ec622b None None] Enqueued Resource ID: 5cd92a27-bbc3-4a4e-8b20-63c38a8c6982 with Priority: HIGHEST for action port [ 1029.656807] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd92a27-bbc3-4a4e-8b20-63c38a8c6982 with Priority: HIGHEST for action port [ 1029.657184] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cd92a27-bbc3-4a4e-8b20-63c38a8c6982 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.657326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cd92a27-bbc3-4a4e-8b20-63c38a8c6982" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.657519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cd92a27-bbc3-4a4e-8b20-63c38a8c6982" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.657634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cd92a27-bbc3-4a4e-8b20-63c38a8c6982" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.657817] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd92a27-bbc3-4a4e-8b20-63c38a8c6982',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.747293] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.748354] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.824026] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1029.824026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.988144] env[65222]: INFO networking_nsxv3.common.synchronization [req-eb39ea2e-7807-4114-bf0d-823dbbc3b6cc req-03f7407c-df86-4b8e-91b0-c15bffe54c06 service nova] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1029.991250] env[65222]: INFO networking_nsxv3.common.synchronization [req-eb39ea2e-7807-4114-bf0d-823dbbc3b6cc req-03f7407c-df86-4b8e-91b0-c15bffe54c06 service nova] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1029.991250] env[65222]: INFO networking_nsxv3.common.synchronization [req-eb39ea2e-7807-4114-bf0d-823dbbc3b6cc req-03f7407c-df86-4b8e-91b0-c15bffe54c06 service nova] Enqueued Resource ID: 0161ec30-f59f-4c00-ab27-7b89198f94f0 with Priority: HIGHEST for action port [ 1029.991250] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1029.991250] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1029.991250] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0161ec30-f59f-4c00-ab27-7b89198f94f0 with Priority: HIGHEST for action port [ 1029.991250] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.991250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.991250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.991250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.991250] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.993181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.994342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.994588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.996531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.996531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.996531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.996531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.996531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.996531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.996531] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.996531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0161ec30-f59f-4c00-ab27-7b89198f94f0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.996905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.996905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.996905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.996905] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0161ec30-f59f-4c00-ab27-7b89198f94f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.161369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cd92a27-bbc3-4a4e-8b20-63c38a8c6982 [ 1030.161645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.161777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.161843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.162148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.162239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.162339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cd92a27-bbc3-4a4e-8b20-63c38a8c6982 already deleted. [ 1030.162419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cd92a27-bbc3-4a4e-8b20-63c38a8c6982" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.252959] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.253355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.253355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.253543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.253636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.253744] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1030.255229] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.255439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.255498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.255739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.255820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.255916] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1030.307783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.307950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.307994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.308220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.308370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.310482] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.310611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.310768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.310854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.310983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.331780] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1030.332773] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1030.500077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.500239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.500438] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.504230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0161ec30-f59f-4c00-ab27-7b89198f94f0 with status ACTIVE [ 1030.506297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.506429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.506498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.506775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.506872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.507333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.507480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.507547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.507914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.508131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.508204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.508304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.508367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.508632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.508735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.508811] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0161ec30-f59f-4c00-ab27-7b89198f94f0 is going to be updated. [ 1030.535118] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.535349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.535457] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.535709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.535912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.536125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0161ec30-f59f-4c00-ab27-7b89198f94f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.562361] env[65222]: INFO networking_nsxv3.common.synchronization [None req-80e5d841-0f78-413c-b04f-afe90e763570 tempest-ServersTestJSON-724195664 tempest-ServersTestJSON-724195664-project-member] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1030.563125] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1030.564052] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.564052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.564052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.564052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.564235] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.909077] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: SUCCESS [ 1030.909077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.909077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.909077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.909077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.909333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.909333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.909518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.909708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.909806] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.007239] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.087239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.087239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.087239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.087239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.087239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.087239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 already deleted. [ 1031.087239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.103212] env[65222]: INFO networking_nsxv3.common.synchronization [None req-665c7cbf-3208-4f69-ae77-6c4b2a538c69 tempest-ServersTestJSON-724195664 tempest-ServersTestJSON-724195664-project-member] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1031.103958] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1031.105588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.105796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.105870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.106125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.106215] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.158048] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1031.158247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.158743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.158784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.159899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.159899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.159899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.159899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.159899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.159899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.159899] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.416750] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.513680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.513680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.513680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.513680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.513680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.513680] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be created. [ 1031.542463] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.542463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.542463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.542463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.542761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.555256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: UNINITIALIZED for 2s [ 1031.644475] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.644694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.644739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.644936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.645106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.645194] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 already deleted. [ 1031.645239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.667952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.668233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.668341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.668678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.668954] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.670330] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.670330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.670330] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.671834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.671834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.671834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.671834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.671834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.671834] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.924609] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.175896] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 1032.207868] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.207868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.207868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.208099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.208184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.208395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.208502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.208585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.208833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.208947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.209281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.209447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.209575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.209732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.209888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.210157] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.210268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.210326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.210475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.210593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.210782] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1032.326717] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.327162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.327162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.327434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.327693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.349750] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1032.350194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.350388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.350624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.350823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.350941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.351221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.351221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.351377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.351377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.351472] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.355557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.355773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.355999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.357011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.357011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.357011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.357011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.357011] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.363835] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1032.369371] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1032.369914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.370654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.370825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.372073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.372073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.372073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.372073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.372073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.372073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.372073] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.372951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.373667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.374661] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.377330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.377330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.377330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.377330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.377330] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.426541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.426845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.426845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.427073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.427174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.427278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be updated. [ 1032.474104] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.474268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.474451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.474576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.474694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.493879] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: IN_PROGRESS for 2s [ 1032.862280] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.862280] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.877603] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.877882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.877953] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.362059] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e05a7a00-b8fe-40b0-96db-3fd1b570f076: rpc.has_security_group_logging(os_id): False [ 1033.363571] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.382025] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.384806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.384961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.385030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.385263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.385324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.386104] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.386104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.386104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.386104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.386104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.386104] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be created. [ 1033.446379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.446866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.446866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.447347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.447607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.460269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1033.567551] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1033.567770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.567938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.568211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.568417] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.568593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.568593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.568733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.568864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.568900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.568995] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.867541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.868219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.868219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.868219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.868435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.868435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1033.884963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.885155] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.885232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.885500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.885640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.885783] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1033.915507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.915773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.915773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.916053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.916053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.917935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.918095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.918166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.918295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.918421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.940647] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1033.940647] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1034.072469] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.385950] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1034.386175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.511116] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: SUCCESS [ 1034.511413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.511508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.511738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.512464] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.512464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.512464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.512464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.512464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.512752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.512752] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.576736] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e3fb04a-0d3f-4197-972f-8af0b18716d2: rpc.has_security_group_logging(os_id): False [ 1034.603047] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.603261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.603341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.603568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.603659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.603920] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.604033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.604089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.604249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.604350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.604476] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be created. [ 1034.687695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.687844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.688187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.688187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.688309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.703199] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1035.018715] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.475787] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1035.476114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.476329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.476596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.476711] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.522326] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 806c8c4c-c741-481d-b9ad-0da164be396a: rpc.has_security_group_logging(os_id): False [ 1035.541244] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.541611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.541611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.541866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.541956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.542220] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.542355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.542429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.542553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.542666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.542740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be created. [ 1035.752354] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.752518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.752559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.752765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.752941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.767057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: IN_PROGRESS for 2s [ 1035.953907] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1035.954248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.955375] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1035.955375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.955375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.955707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.955958] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.956094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.956197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.956382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.956501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.956607] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.957561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.957679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.961239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.961365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.961431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.961588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.961668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.961760] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.978847] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.979079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.106546] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1036.106844] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 1036.465157] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.467495] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.719492] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1036.719492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.969062] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.970441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.055099] env[65222]: INFO networking_nsxv3.common.synchronization [req-955ee983-9813-451f-b172-c50d58b6967f req-639d8731-b360-4e78-8ae5-4c72c2e3afcc tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1037.055699] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1037.057213] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.057645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.057925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.058222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.058591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.058934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.059044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.059258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.059510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.059648] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.118401] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4e0aab77-29d0-4c14-8aca-f29e915068eb None None] Enqueued Resource ID: 9d8f287e-1370-48ef-a4bf-f38735e77aed with Priority: HIGHEST for action port [ 1037.118669] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8f287e-1370-48ef-a4bf-f38735e77aed with Priority: HIGHEST for action port [ 1037.119256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8f287e-1370-48ef-a4bf-f38735e77aed taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.119378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8f287e-1370-48ef-a4bf-f38735e77aed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.119548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8f287e-1370-48ef-a4bf-f38735e77aed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.119708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8f287e-1370-48ef-a4bf-f38735e77aed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.120261] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8f287e-1370-48ef-a4bf-f38735e77aed',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.472950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.472950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.473138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.473285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.473381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.473487] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1037.475450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.475450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.475450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.475688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.475688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.475797] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1037.530712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.530986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.531092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.531289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.531438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.533874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.534101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.535072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.535072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.535072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.546408] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1037.547121] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1037.562740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.621484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d8f287e-1370-48ef-a4bf-f38735e77aed [ 1037.621618] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.621749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.621811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.623038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.623038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.623038] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d8f287e-1370-48ef-a4bf-f38735e77aed already deleted. [ 1037.624600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8f287e-1370-48ef-a4bf-f38735e77aed" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.786780] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: SUCCESS [ 1037.787138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.065918] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.172722] env[65222]: INFO networking_nsxv3.common.synchronization [req-9f407202-acc4-4417-b518-7267d7141296 req-d089dd69-e610-426e-9f0c-84ca443cdbec tempest-ServersAdminNegativeTestJSON-971697259 tempest-ServersAdminNegativeTestJSON-971697259-project-member] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1038.172722] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1038.172873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.172934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.172973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.173623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.173793] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.173900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.173964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.174148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.174248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.174388] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.569046] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.569275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.569328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.569935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.569935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.569935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1038.605118] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.607290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.607290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.607290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.607290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.621436] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1038.626640] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.626640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.626640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.626901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.627057] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.627221] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.627336] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.629485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.629485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.629485] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.629485] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.629485] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.629485] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.629485] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.629485] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.629485] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.650677] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.650855] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.651014] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.651219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-245" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.651557] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.652764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.652764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.654582] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.655154] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e170fb-471f-4d75-9fb2-bf5b26c2479d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.678479] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.161693] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.162172] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.162266] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.162820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.162820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.162910] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port e5e170fb-471f-4d75-9fb2-bf5b26c2479d not found, creating... [ 1039.163292] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.163462] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.163581] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.163815] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.163955] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.167667] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.167852] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.167973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.168242] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.168387] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.168540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: e5e170fb-471f-4d75-9fb2-bf5b26c2479d is going to be created. [ 1039.180128] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.198385] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.198649] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.198726] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.199015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.199237] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.199462] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.559108] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1039.559108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.559108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.560526] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.560526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.560526] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.562651] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1039.562651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.562651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.562651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.562877] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.562877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.562877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.563092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.563202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.563202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.563395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.563484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.563561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.563677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.563815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.563918] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.563984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.564105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.564173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.564250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.564337] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.683050] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.683050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.683050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.683312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.683312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.683561] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be updated. [ 1039.724160] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.724160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.724160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.724160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.724160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.727445] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e41cae99-7276-4c33-a06f-bf2f8e42fcd8 None None] Enqueued Resource ID: 95a2e8aa-173e-4285-b645-b01f4e3061d8 with Priority: HIGHEST for action port [ 1039.727989] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95a2e8aa-173e-4285-b645-b01f4e3061d8 with Priority: HIGHEST for action port [ 1039.728410] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-95a2e8aa-173e-4285-b645-b01f4e3061d8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.728525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95a2e8aa-173e-4285-b645-b01f4e3061d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.728525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95a2e8aa-173e-4285-b645-b01f4e3061d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.728881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95a2e8aa-173e-4285-b645-b01f4e3061d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.729027] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95a2e8aa-173e-4285-b645-b01f4e3061d8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.736254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1039.968401] env[65222]: INFO networking_nsxv3.common.synchronization [req-2c9cb409-3620-45ad-bf18-236a839609a0 req-9d2ead33-eee4-450e-bfa9-707800f09c71 tempest-ServersTestJSON-724195664 tempest-ServersTestJSON-724195664-project-member] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1039.969133] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1039.969533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.969734] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.969845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.970191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.970439] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.970606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.970725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.971195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.971490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.971656] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.991192] env[65222]: INFO networking_nsxv3.common.synchronization [req-9f407202-acc4-4417-b518-7267d7141296 req-e3860e99-6caa-4b5e-a35e-5475dc0e6b25 service nova] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_rules [ 1039.991402] env[65222]: INFO networking_nsxv3.common.synchronization [req-9f407202-acc4-4417-b518-7267d7141296 req-e3860e99-6caa-4b5e-a35e-5475dc0e6b25 service nova] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1039.991542] env[65222]: INFO networking_nsxv3.common.synchronization [req-9f407202-acc4-4417-b518-7267d7141296 req-e3860e99-6caa-4b5e-a35e-5475dc0e6b25 service nova] Enqueued Resource ID: e5e170fb-471f-4d75-9fb2-bf5b26c2479d with Priority: HIGHEST for action port [ 1039.992121] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_rules [ 1039.992734] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1039.992909] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e170fb-471f-4d75-9fb2-bf5b26c2479d with Priority: HIGHEST for action port [ 1039.995313] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.996034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.996034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.996034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.996219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.998621] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.998790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.000192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.000192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.000192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.000192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.000192] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e170fb-471f-4d75-9fb2-bf5b26c2479d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.066105] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.067976] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1040.094589] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.094589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.094589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.094589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.094589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.094912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.094912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.094912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.095038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.095071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.095242] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.095330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.095387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.095523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.095590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.095766] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.095849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.096727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.096727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.096727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.096727] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1040.203464] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.203737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.203737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.203914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.204065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.219443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1040.231391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95a2e8aa-173e-4285-b645-b01f4e3061d8 [ 1040.231738] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.231893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.233304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.233304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.233304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.233304] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95a2e8aa-173e-4285-b645-b01f4e3061d8 already deleted. [ 1040.233304] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95a2e8aa-173e-4285-b645-b01f4e3061d8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.323561] env[65222]: INFO networking_nsxv3.common.synchronization [req-094c4761-6df7-45cb-9201-0181491b6ea3 req-34de7303-fe68-4b16-a378-072319f79caa tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: 5a83ed0a-8d20-4ee2-9c14-446df1d51100 with Priority: HIGHEST for action security_group_rules [ 1040.325375] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a83ed0a-8d20-4ee2-9c14-446df1d51100 with Priority: HIGHEST for action security_group_rules [ 1040.325830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a83ed0a-8d20-4ee2-9c14-446df1d51100 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.325985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a83ed0a-8d20-4ee2-9c14-446df1d51100" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.326087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a83ed0a-8d20-4ee2-9c14-446df1d51100" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.326420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a83ed0a-8d20-4ee2-9c14-446df1d51100" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.326526] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a83ed0a-8d20-4ee2-9c14-446df1d51100',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.338785] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.339074] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-660" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.339549] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-660" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.339672] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-660" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.340027] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.344594] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.344809] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.345187] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.345396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.345689] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.345871] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.346520] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.346520] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.346520] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.346520] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.346809] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.373985] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.373985] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.373985] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.374163] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-660" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.374485] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-745f45c6-2826-4488-9607-8c4ecb07107d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.375216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.375216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.375216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.375377] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('745f45c6-2826-4488-9607-8c4ecb07107d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.475281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.475281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.475281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.475467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.475578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.475766] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.476294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.476294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.476294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.476294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.476294] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 already deleted. [ 1040.476590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.501807] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.502038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.505203] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5e170fb-471f-4d75-9fb2-bf5b26c2479d with status ACTIVE [ 1040.505203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.505203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.505203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.505417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.505518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.506355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.506355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.506355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.506355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.506582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.506676] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.506822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.506921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.507175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.507265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507386] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5e170fb-471f-4d75-9fb2-bf5b26c2479d is going to be updated. [ 1040.535923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.536088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.536179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.536385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.536526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.536695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e170fb-471f-4d75-9fb2-bf5b26c2479d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.571588] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e05a7a00-b8fe-40b0-96db-3fd1b570f076: rpc.has_security_group_logging(os_id): False [ 1040.593089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.593446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.593446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.593673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.593760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.594491] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.594678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.594775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.594979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.595082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.595210] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1040.634157] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1040.634157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.676213] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.676213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.676213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.676213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.676213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.693497] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1040.835715] env[65222]: INFO networking_nsxv3.common.synchronization [req-b138ede7-d1a2-43bd-882d-7266a8ec86fc req-ed5c7f48-012b-452a-9043-852115e98ff8 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1040.835715] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1040.835715] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.835715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.835715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.836338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.837262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.837812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.837986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.838311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.838529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.838683] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.849438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.852368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.852500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.852952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.852952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.853120] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a83ed0a-8d20-4ee2-9c14-446df1d51100 already deleted. [ 1040.853267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a83ed0a-8d20-4ee2-9c14-446df1d51100" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.880911] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.881144] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.881272] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.881554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.881705] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.881861] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 745f45c6-2826-4488-9607-8c4ecb07107d not found, creating... [ 1040.882157] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.882328] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.882445] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.882679] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.882814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.883207] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.883393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.883515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.883725] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.883862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.883996] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 745f45c6-2826-4488-9607-8c4ecb07107d is going to be created. [ 1040.905895] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.906182] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.906292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.906564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.906789] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.907017] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.349025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.349025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.349025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.349025] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1041.389981] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.389981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.389981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.390475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.390622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.400086] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1041.687439] env[65222]: INFO networking_nsxv3.common.synchronization [req-2c9cb409-3620-45ad-bf18-236a839609a0 req-2d7039a2-235c-4ca1-b84a-42d59dea6d70 service nova] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1041.687722] env[65222]: INFO networking_nsxv3.common.synchronization [req-2c9cb409-3620-45ad-bf18-236a839609a0 req-2d7039a2-235c-4ca1-b84a-42d59dea6d70 service nova] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1041.687919] env[65222]: INFO networking_nsxv3.common.synchronization [req-2c9cb409-3620-45ad-bf18-236a839609a0 req-2d7039a2-235c-4ca1-b84a-42d59dea6d70 service nova] Enqueued Resource ID: 745f45c6-2826-4488-9607-8c4ecb07107d with Priority: HIGHEST for action port [ 1041.692725] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_rules [ 1041.692725] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1041.692725] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745f45c6-2826-4488-9607-8c4ecb07107d with Priority: HIGHEST for action port [ 1041.692725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.692725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.692725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.693976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.694105] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.695854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.696296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.696449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.696737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.696957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.697161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.697218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.697655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.697655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.697655] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.700723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-745f45c6-2826-4488-9607-8c4ecb07107d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.700962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.700962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.702083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.702083] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('745f45c6-2826-4488-9607-8c4ecb07107d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.748400] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1041.748658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.750289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.750534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.750727] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.750847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.750916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.751075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.751160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.751257] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.202856] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.203976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.204112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.204817] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 745f45c6-2826-4488-9607-8c4ecb07107d with status ACTIVE [ 1042.204817] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.204817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.204817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.205071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.205231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.206028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.206028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.206028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.206028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.206028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.206028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.206399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.206399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.206399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.206399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.206399] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 745f45c6-2826-4488-9607-8c4ecb07107d is going to be updated. [ 1042.231810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.231994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.232042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.232306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.232423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.232590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-745f45c6-2826-4488-9607-8c4ecb07107d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.233778] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1042.233988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.235783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.235783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.235783] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.254104] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.280516] env[65222]: INFO networking_nsxv3.common.synchronization [req-9a4f042a-7777-4a0d-b268-2762c6740c5e req-f33f04a3-cbdd-4e73-90c6-d340e8aaa311 tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: f8e05820-69bb-4cb0-a4fd-4ee9bd114e20 with Priority: HIGHEST for action security_group_rules [ 1042.280516] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e05820-69bb-4cb0-a4fd-4ee9bd114e20 with Priority: HIGHEST for action security_group_rules [ 1042.280516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e05820-69bb-4cb0-a4fd-4ee9bd114e20 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.280933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e05820-69bb-4cb0-a4fd-4ee9bd114e20" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.281134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e05820-69bb-4cb0-a4fd-4ee9bd114e20" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.281492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e05820-69bb-4cb0-a4fd-4ee9bd114e20" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.281701] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e05820-69bb-4cb0-a4fd-4ee9bd114e20',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.705040] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.713078] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1042.713185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.737897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.739178] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.739178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.739178] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.758421] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.809451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.809630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.809735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.810056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.810196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.810338] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e05820-69bb-4cb0-a4fd-4ee9bd114e20 already deleted. [ 1042.810469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e05820-69bb-4cb0-a4fd-4ee9bd114e20" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.208736] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.208736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.208976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.209057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.209162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.209271] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 is going to be created. [ 1043.242335] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.242335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.242335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.242335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.242335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.243714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.243944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.244059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.244267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.244489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.244615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.244686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.244901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.244986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245362] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.245467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.245532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.245753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.245918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.246029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.246095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.246284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.246365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.246450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.246605] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.258109] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: UNINITIALIZED for 2s [ 1043.260960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.261214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.261459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.261754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.261892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.262051] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be updated. [ 1043.311715] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.312273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.312413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.312670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.312839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.325591] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1043.413640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1043.413832] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1043.413991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.749179] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1043.769054] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.769251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.769317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.769489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.769568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.769794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.769890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.769948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.770135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.770235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.770366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.770478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.770557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.770644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.770723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.770886] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.770999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.772917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.774436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.774582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.774693] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1043.845326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.845326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.845567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.845611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.845793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.863035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1043.871751] env[65222]: INFO networking_nsxv3.common.synchronization [req-8fa75fc5-1f02-41ee-b541-4bf6b8d58a28 req-ed6f9b61-4369-441f-8ff0-b161209ea9bd tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: a1bf4934-5c05-4d3a-8136-03e9ebdb4691 with Priority: HIGHEST for action security_group_rules [ 1043.872549] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1bf4934-5c05-4d3a-8136-03e9ebdb4691 with Priority: HIGHEST for action security_group_rules [ 1043.872975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1bf4934-5c05-4d3a-8136-03e9ebdb4691 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.873147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1bf4934-5c05-4d3a-8136-03e9ebdb4691" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.873193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1bf4934-5c05-4d3a-8136-03e9ebdb4691" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.873502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1bf4934-5c05-4d3a-8136-03e9ebdb4691" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.873589] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1bf4934-5c05-4d3a-8136-03e9ebdb4691',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.127389] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf82597b-5c9a-42dd-9658-ecfd34acc21c req-300e2c7c-c6fb-4074-a9fb-b9eaebc98fde tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1044.127389] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1044.127587] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.127587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.127758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.128055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.128163] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.128221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.129127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.129127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.129127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.129127] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.396698] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.397061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.397169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.397409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.397591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.397656] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1bf4934-5c05-4d3a-8136-03e9ebdb4691 already deleted. [ 1044.397709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1bf4934-5c05-4d3a-8136-03e9ebdb4691" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.483446] env[65222]: INFO networking_nsxv3.common.synchronization [req-dd8c32e5-57fe-4b9b-9c44-aeb6201ccdd9 req-c08073d8-bea4-4268-aa3c-7730c5b90a95 tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1044.484167] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1044.484584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.484677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.484778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.485017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.485400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.485400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.485400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.485555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.485645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.485744] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.633858] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.700265] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.700265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.700265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.700632] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.701773] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.701773] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.701893] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.702156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.702346] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.702618] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.702774] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.702926] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.703117] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.703263] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.703501] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.703727] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.732186] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.732186] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.732186] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.732466] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.732877] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.733171] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.733407] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.733813] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.734031] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5caba01-50fc-4ba5-a7c7-663bbf0e49f5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.988817] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.099081] env[65222]: INFO networking_nsxv3.common.synchronization [req-87bf5496-c02f-4b30-94c1-32bb1efb09e3 req-6109140a-a7f7-49b0-8ceb-0019e87f5c3f tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1045.099649] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1045.099974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.100117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.100181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.100406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.100578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.100700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.100741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.100913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.101023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.101115] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.137110] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.237062] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.237351] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.237532] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.237823] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.237973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.238862] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 not found, creating... [ 1045.238862] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.238862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.238862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.239144] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.239144] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.239425] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.239579] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.240284] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.240284] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.240390] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.240522] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 is going to be created. [ 1045.265619] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.265912] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.266090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.269680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.269872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.270159] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.272889] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: SUCCESS [ 1045.272889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.272889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.273083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.273134] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.273237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.273388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.273643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.273753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.273870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.274039] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.337961] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1045.338342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.338936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.339132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.339377] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.339565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.339674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.339878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.340072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.340171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.340299] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.492409] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.603530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.603703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.603743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.603961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.604066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.604265] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.604626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.604626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.604626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.604626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.604762] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1045.634541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.634720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.634776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.634960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.635125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.638629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.638762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.638854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.639040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.639126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.639230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1045.649347] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1045.675515] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.675705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.675754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.675974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.676148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.685492] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1045.778585] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.843997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.844194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.844267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.844559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.845378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.845526] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.845598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.845777] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.845937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.846121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.846310] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.846442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.846534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.846724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.847150] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.847150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.847150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.847492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.847492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.847492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.847492] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.881416] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1045.881416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf82597b-5c9a-42dd-9658-ecfd34acc21c req-95011879-43fe-40b3-b659-07ea0178a73f service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf82597b-5c9a-42dd-9658-ecfd34acc21c req-95011879-43fe-40b3-b659-07ea0178a73f service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [req-bf82597b-5c9a-42dd-9658-ecfd34acc21c req-95011879-43fe-40b3-b659-07ea0178a73f service nova] Enqueued Resource ID: a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 with Priority: HIGHEST for action port [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1045.975252] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 with Priority: HIGHEST for action port [ 1045.975515] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.975607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.975607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.975806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.975881] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.977271] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.977379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.977646] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.977739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.977778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.980237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.980237] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5caba01-50fc-4ba5-a7c7-663bbf0e49f5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.994631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.995130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.995130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.995130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.995130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.995390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1046.024044] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.024227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.024298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.024527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.024902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.035239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1046.185483] env[65222]: INFO networking_nsxv3.common.synchronization [req-55169123-0a2e-434a-a986-3c3478e1e206 req-75a00536-8405-427f-9b85-250799e7ff83 tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: 2b437e1a-7782-468a-be89-f7be34b9ab1d with Priority: HIGHEST for action security_group_rules [ 1046.186331] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b437e1a-7782-468a-be89-f7be34b9ab1d with Priority: HIGHEST for action security_group_rules [ 1046.186903] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b437e1a-7782-468a-be89-f7be34b9ab1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.187151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b437e1a-7782-468a-be89-f7be34b9ab1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.187276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b437e1a-7782-468a-be89-f7be34b9ab1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.187842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b437e1a-7782-468a-be89-f7be34b9ab1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.187842] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b437e1a-7782-468a-be89-f7be34b9ab1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.281236] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f6b2a52-a6df-4aec-9cd6-da7e43f26431: rpc.has_security_group_logging(os_id): False [ 1046.325076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.325076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.325076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.326209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.326209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.326209] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 is going to be created. [ 1046.350786] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a055c4f3-b6b2-41d3-9478-9a1e5a156588: rpc.has_security_group_logging(os_id): False [ 1046.370532] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.370532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.370685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.371268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.371268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.371268] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.371268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.371481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.371481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.371544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.372027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.372027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.372027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.372285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.372285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.372398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.372476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.372719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.372943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.372995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.373094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be updated. [ 1046.408360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.408519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.408582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.408784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.408961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.421339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: IN_PROGRESS for 2s [ 1046.447280] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.447450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.447520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.447701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.447843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.467251] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1046.479784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.479915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.480112] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 with status ACTIVE [ 1046.480277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.480439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.480439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.480716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.480716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.480888] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.480983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.481058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.481390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.481390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.481533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.481533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.481643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.481723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.481794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.481923] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5caba01-50fc-4ba5-a7c7-663bbf0e49f5 is going to be updated. [ 1046.515541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.515674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.515828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.515961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.516103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.516263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5caba01-50fc-4ba5-a7c7-663bbf0e49f5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.712498] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.712593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.713152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.713152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.713152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.713152] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b437e1a-7782-468a-be89-f7be34b9ab1d already deleted. [ 1046.713152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b437e1a-7782-468a-be89-f7be34b9ab1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.736025] env[65222]: INFO networking_nsxv3.common.synchronization [req-d20fc596-3393-4978-8548-f1a6070273b2 req-cb4f17aa-2a2e-4f36-a5de-d7feef8dac43 tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1046.736025] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1046.736690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.736957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.737142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.738376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.738376] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f219e4-71ef-46d7-b5ee-36906e5bba47',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.887680] env[65222]: INFO networking_nsxv3.common.synchronization [req-8fc4ea7d-cfde-4dbe-b7c8-7c0cde4ddddc req-419075f7-dbdf-4e64-aec7-50e54c958a34 tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1046.887819] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1046.888533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.888681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.267228] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.267228] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 already deleted. [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.267228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.267228] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f219e4-71ef-46d7-b5ee-36906e5bba47',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.377900] env[65222]: INFO networking_nsxv3.common.synchronization [req-c1e0ec6d-fc82-44c5-837c-bbf285361ad5 req-d0089cfa-6b4d-4059-a3ac-e22170deb393 tempest-SecurityGroupRulesTestJSON-1786272647 tempest-SecurityGroupRulesTestJSON-1786272647-project-member] Enqueued Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1047.377900] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 with Priority: HIGHEST for action security_group_rules [ 1047.377900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.377900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.661240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1047.661422] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 deletion is rescheduled due to dependency. [ 1047.661537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.696654] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1047.696888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.697109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.697444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.697663] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.697847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.697949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.698212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.698348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.698502] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.798063] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.798063] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 already deleted. [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.798063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.798902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.798902] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f219e4-71ef-46d7-b5ee-36906e5bba47',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.051480] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1048.051861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.201222] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.324732] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.325108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.325108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.325254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.325330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.325365] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f219e4-71ef-46d7-b5ee-36906e5bba47 already deleted. [ 1048.325487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f219e4-71ef-46d7-b5ee-36906e5bba47" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.434982] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: SUCCESS [ 1048.435241] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.483151] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1048.484508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.706428] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.209375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.209682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.209682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.210097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.210097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.210226] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1049.248790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.251783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.251783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.251783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.251783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.261790] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1049.967192] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.968540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.968540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.968540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.968540] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.471255] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.974449] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.275478] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1051.275478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.275478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.275478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.275478] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.275478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.276038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.276277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.276404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.276536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.276669] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.478272] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1051.478272] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1051.779718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.780317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.780317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.780317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.780459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.780459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.780554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.780979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.781058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.781166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.781344] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.781425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.781477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.781649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.782034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.782169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.782255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.782444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.782529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.782614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.782706] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.289407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1052.314111] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.314111] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.314111] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.314848] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.314848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.314848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.314848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.314848] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1052.324303] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.324303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.324303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.324303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.337036] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1052.338226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.342097] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1052.373458] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.373717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.373717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.373958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.388998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.389945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1052.389945] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.390269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1052.391300] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1052.391458] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1052.392707] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.393638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.393722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.393936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.394593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.413315] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1052.475024] env[65222]: INFO networking_nsxv3.common.synchronization [None req-8398e2d9-75a4-41c7-bf81-5b42678b442d None None] Enqueued Resource ID: 42a964d8-fe30-48da-82f7-93912a300aa9 with Priority: HIGHEST for action port [ 1052.476666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.477035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.477318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.477811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.479654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.479996] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1052.481896] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a964d8-fe30-48da-82f7-93912a300aa9 with Priority: HIGHEST for action port [ 1052.484072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a964d8-fe30-48da-82f7-93912a300aa9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.485018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a964d8-fe30-48da-82f7-93912a300aa9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.486018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a964d8-fe30-48da-82f7-93912a300aa9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.486018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a964d8-fe30-48da-82f7-93912a300aa9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.486018] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a964d8-fe30-48da-82f7-93912a300aa9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.576695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.576934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.577064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.577353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.577764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.578304] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1052.670386] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.670915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.671201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.671521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.672060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.672965] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1052.673141] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'013f0bc7-93b5-439a-93c1-4391408844fb', '309c514b-b141-440e-916b-43a229296f1d', 'ca7d31cf-9989-4765-9a76-058b268adcef', 'deb58d10-eb3b-46ea-87ea-d75bc77a65e2', 'ef0e22a7-af6f-4355-8779-ca32518594be', '2c338b2c-c780-410a-aac2-962f91390b3f', 'e05a7a00-b8fe-40b0-96db-3fd1b570f076', '11d644ad-a174-4566-8821-3c943c124335', 'aaf2c545-8660-4507-8e07-7248fbb414a5', 'c156d898-0c95-428d-be52-aca57ef2133f', '806c8c4c-c741-481d-b9ad-0da164be396a', 'd6e292cc-368f-4af4-9a2c-e739a92ac09e', '82be25be-b943-41e8-a603-dee27a20c6f9', 'a5069f7f-5460-4aba-91e3-1ff69c00f601', '6ba84537-4aba-48c8-aa91-19210e1c0cf1', '39045f59-5600-413e-a6df-437146897c8f', '934c2ee4-8fd3-4a49-b822-071d800eb172', '9115f62f-c7b4-4e8a-b399-29989bafdeff', '9616c573-a4bd-486e-9a65-e040235f1bd2', '4eb5605d-d158-4afb-b319-53f3e5ce181c', '6e3fb04a-0d3f-4197-972f-8af0b18716d2', '7cdeb067-1c84-46bf-b468-65ab19cb86dc', 'bbaddab6-0327-438e-a968-548042cf4e7a', 'a1afa0b0-3cbd-4920-98be-230a695a0592', '034ec8fb-de90-4302-acab-f4bec595dd2d', 'bedc55f5-0ad2-4b84-aab1-d26ca6737e7a', '6355cca5-8c96-4bbb-bc95-01de745d5b8c', '0d779a56-b08e-4d96-a298-035aff7f597c', '15ef4155-817c-4a1e-8484-6fde2baef247', '124a99d3-fe24-481b-88c5-184d5a1c99ee', '67a33950-b193-4a08-b38a-6d6532bafae7', '4a1f130e-cc8b-4415-87be-b7a8cbdda189', '6f6b2a52-a6df-4aec-9cd6-da7e43f26431', '3611c6f7-c786-4748-b4fa-faf7bcfceab1', '44afacd5-bc37-4272-9409-ec05ce0c00f8', 'a055c4f3-b6b2-41d3-9478-9a1e5a156588', '3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3', 'a50b6578-c051-4750-b9bb-002f9ba016ff', 'a4c36af1-3224-4449-b91e-20d98bbff745', '2fbc24f1-8254-4b9b-9b11-d6605f74d8db', '8e8b0390-6b22-4e1a-92fa-1046e5b93e83'} {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.673375] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1052.698164] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.698443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.698443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.698643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.698723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.698907] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1052.698907] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.699077] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1052.772509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.772687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.773586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.773586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.774154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.774454] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1052.774578] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.774668] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1052.774738] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1052.774808] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1052.774873] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGH for action security_group_rules [ 1052.774972] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGH for action security_group_rules [ 1052.775035] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGH for action security_group_rules [ 1052.775086] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1052.775130] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGH for action security_group_rules [ 1052.775180] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGH for action security_group_rules [ 1052.775277] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGH for action security_group_rules [ 1052.775333] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGH for action security_group_rules [ 1052.775636] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGH for action security_group_rules [ 1052.775917] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGH for action security_group_rules [ 1052.775917] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGH for action security_group_rules [ 1052.775917] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGH for action security_group_rules [ 1052.775917] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGH for action security_group_rules [ 1052.776098] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGH for action security_group_rules [ 1052.776398] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGH for action security_group_rules [ 1052.776539] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.862829] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a4202fdd-a937-4d0c-a2a6-faffe125f312 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1052.863722] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1052.863722] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013f0bc7-93b5-439a-93c1-4391408844fb with Priority: HIGH for action security_group_rules [ 1052.863722] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7d31cf-9989-4765-9a76-058b268adcef with Priority: HIGH for action security_group_rules [ 1052.863908] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGH for action security_group_rules [ 1052.863908] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGH for action security_group_rules [ 1052.864345] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGH for action security_group_rules [ 1052.864345] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 with Priority: HIGH for action security_group_rules [ 1052.864345] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff with Priority: HIGH for action security_group_rules [ 1052.864345] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39045f59-5600-413e-a6df-437146897c8f with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82be25be-b943-41e8-a603-dee27a20c6f9 with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGH for action security_group_rules [ 1052.864924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156d898-0c95-428d-be52-aca57ef2133f with Priority: HIGH for action security_group_rules [ 1052.865376] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2c545-8660-4507-8e07-7248fbb414a5 with Priority: HIGH for action security_group_rules [ 1052.865376] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c338b2c-c780-410a-aac2-962f91390b3f with Priority: HIGH for action security_group_rules [ 1052.865376] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d644ad-a174-4566-8821-3c943c124335 with Priority: HIGH for action security_group_rules [ 1052.865376] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef0e22a7-af6f-4355-8779-ca32518594be with Priority: HIGH for action security_group_rules [ 1052.865535] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGH for action security_group_rules [ 1052.865731] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1052.865931] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.866068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.866332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.866479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.866586] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.867564] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-013f0bc7-93b5-439a-93c1-4391408844fb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.867686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.867754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.867935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.868032] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('013f0bc7-93b5-439a-93c1-4391408844fb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.869257] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7d31cf-9989-4765-9a76-058b268adcef taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.869257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.869386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.869595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.869595] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7d31cf-9989-4765-9a76-058b268adcef',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.870990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.870990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.870990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.871238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.871238] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.872749] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.872749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.872749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.872749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.872749] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.873532] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.873532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.873697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.874227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.874227] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.874954] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9616c573-a4bd-486e-9a65-e040235f1bd2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.874954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.875359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.875359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.875359] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9616c573-a4bd-486e-9a65-e040235f1bd2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.876437] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9115f62f-c7b4-4e8a-b399-29989bafdeff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.876437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.876437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.876437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.876437] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9115f62f-c7b4-4e8a-b399-29989bafdeff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.878381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934c2ee4-8fd3-4a49-b822-071d800eb172 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.878381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.878381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.878381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.878381] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934c2ee4-8fd3-4a49-b822-071d800eb172',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.878724] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.878724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.878870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.879289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.879289] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.880360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39045f59-5600-413e-a6df-437146897c8f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.880506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.880594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.880766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.881030] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39045f59-5600-413e-a6df-437146897c8f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.881842] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82be25be-b943-41e8-a603-dee27a20c6f9 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.882136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.882259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.882432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.882532] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82be25be-b943-41e8-a603-dee27a20c6f9',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.883358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.883516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.883822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.883822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.883929] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.885105] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.885105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.885105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.885333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.885397] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.886222] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c156d898-0c95-428d-be52-aca57ef2133f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.886355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.886475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.886621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.886768] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c156d898-0c95-428d-be52-aca57ef2133f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.887728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf2c545-8660-4507-8e07-7248fbb414a5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.887911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.887991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.888237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.888338] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf2c545-8660-4507-8e07-7248fbb414a5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.889176] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c338b2c-c780-410a-aac2-962f91390b3f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.889282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.889339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.889550] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.889635] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c338b2c-c780-410a-aac2-962f91390b3f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.891098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11d644ad-a174-4566-8821-3c943c124335 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.891098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.891098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.891305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.891305] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11d644ad-a174-4566-8821-3c943c124335',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.892733] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef0e22a7-af6f-4355-8779-ca32518594be taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.894067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.896579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.896874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.897045] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef0e22a7-af6f-4355-8779-ca32518594be',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.898426] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.898606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.898699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.899081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.899225] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.899591] env[65222]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1052.901833] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.901963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.902021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.902328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.902328] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.990725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42a964d8-fe30-48da-82f7-93912a300aa9 [ 1052.990725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.990725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.990725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42a964d8-fe30-48da-82f7-93912a300aa9 already deleted. [ 1052.990725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a964d8-fe30-48da-82f7-93912a300aa9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.026537] env[65222]: INFO networking_nsxv3.common.synchronization [None req-637566d3-97a7-4218-9ede-7697c62f40de tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1053.030225] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1053.030225] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.030225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.320175] env[65222]: INFO networking_nsxv3.common.synchronization [req-8ac6f3c4-9607-4c80-beb3-a0fe4a37aa4a req-504b314c-1171-4a2a-a5b1-40d44d5a1c63 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1053.320702] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1053.321009] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.321221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.321289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.321489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.321638] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.321753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.321872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.322037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.322124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.325592] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.404505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.404735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.404810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.405045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.405794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.405794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.405794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.405794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.405794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.405794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.406028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.411728] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.411728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.411728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.411728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.411949] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.411949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.411949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.412094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.412172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.412270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.412356] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.417183] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.417292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.417418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.417511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.417655] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.417748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.417842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.417942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.418060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.418116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.418194] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.426221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.426366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.426426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.426823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.426823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.426962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.426962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.427484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.427534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427708] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.431008] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.431184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.431227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.431360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.431613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.431671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.431706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.432174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.432174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.432174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.432174] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.432918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.433153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.433153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.433273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.433430] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.433569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.433635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.433712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.433786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.433866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.433949] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.446698] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.447248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.447248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.447248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.447406] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.447477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.447542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.447690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.447774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.447859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.447946] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.455472] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.492074] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.492277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.492330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.493914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.494851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.494951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.495764] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.495827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.496611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.496723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.497748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.497748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.499137] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.499137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.499137] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.499335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.500773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.500868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.501677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.501775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.502925] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.502925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.503509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.503509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.505033] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.505033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.505033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.505653] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.506101] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.506207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.507097] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.507806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.507806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.517216] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.518202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.518202] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be deleted. [ 1053.519623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.519833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.540131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.540277] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9616c573-a4bd-486e-9a65-e040235f1bd2 is going to be deleted. [ 1053.541311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.541560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.565375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.566174] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c338b2c-c780-410a-aac2-962f91390b3f is going to be deleted. [ 1053.567024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.567024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.580055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.580192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.589484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.589547] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 013f0bc7-93b5-439a-93c1-4391408844fb is going to be deleted. [ 1053.590896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.591173] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.600658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.600658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.617444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.617444] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c156d898-0c95-428d-be52-aca57ef2133f is going to be deleted. [ 1053.617792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.618311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.673435] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.673564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.690256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.690425] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11d644ad-a174-4566-8821-3c943c124335 is going to be deleted. [ 1053.691483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.691723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.736780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.736949] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82be25be-b943-41e8-a603-dee27a20c6f9 is going to be deleted. [ 1053.737876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.739000] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.759284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.759430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.762811] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.762811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.792442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.794023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9115f62f-c7b4-4e8a-b399-29989bafdeff is going to be deleted. [ 1053.794023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.794023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.815428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.815657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.830393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.830393] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf2c545-8660-4507-8e07-7248fbb414a5 is going to be deleted. [ 1053.830835] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.831802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.832447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.832447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.832447] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 already deleted. [ 1053.832447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.832656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.832737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.833693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.833862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.834262] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.883531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.883669] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7d31cf-9989-4765-9a76-058b268adcef is going to be deleted. [ 1053.884647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.884870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.898760] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.898959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.901299] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.901527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.901659] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.901902] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.902243] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.902622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.902788] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.903045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.903194] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.903466] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.903583] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.903730] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.903798] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.903899] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.904013] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.904153] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.909893] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.933679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.933840] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39045f59-5600-413e-a6df-437146897c8f is going to be deleted. [ 1053.935054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.935268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.936281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.936412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.936481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.936648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.936809] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.936912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.936978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.937362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.937362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.937362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.937560] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.937560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.937560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.937696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.937843] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.937928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.937986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.938140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.938216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.938301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.938391] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.940633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.940760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.940808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.940947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.941112] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.941210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.941273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.941469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.941517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.941575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.941721] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.941815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.941874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.942015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.942191] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.942356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.942417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.942546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.942618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.942700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.942789] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.945745] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.948643] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.958740] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.967602] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5069f7f-5460-4aba-91e3-1ff69c00f601: rpc.has_security_group_logging(os_id): False [ 1053.976778] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.978126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.978298] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.074 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.978427] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.978597] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.979041] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-99c9a293-f1e9-4fa0-97ca-4417174da42b taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.979185] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.979305] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.980032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.980032] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99c9a293-f1e9-4fa0-97ca-4417174da42b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.986125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.986287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.991983] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.992741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.993442] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.993598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.995773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.995881] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef0e22a7-af6f-4355-8779-ca32518594be is going to be deleted. [ 1053.997129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.997129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.016415] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b81d21c7-22dc-470d-ac65-ffc964489577 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1054.017055] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1054.017394] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.017514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.017581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.017922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.017922] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.094999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.095174] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934c2ee4-8fd3-4a49-b822-071d800eb172 is going to be deleted. [ 1054.096143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.096361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.096455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.096587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.096746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.096902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.096980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.097117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9616c573-a4bd-486e-9a65-e040235f1bd2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.097763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.097941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.098057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.098186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c338b2c-c780-410a-aac2-962f91390b3f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.098705] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.098861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.098941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.099067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-013f0bc7-93b5-439a-93c1-4391408844fb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.099197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.099339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.099495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.099617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c156d898-0c95-428d-be52-aca57ef2133f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.099742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.099884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.099958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.100091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11d644ad-a174-4566-8821-3c943c124335" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.100311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.100460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.100534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.100645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82be25be-b943-41e8-a603-dee27a20c6f9" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.100771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.100908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.100982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.101101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9115f62f-c7b4-4e8a-b399-29989bafdeff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.101227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.101364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.101436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.101543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf2c545-8660-4507-8e07-7248fbb414a5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.101663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.101795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.101897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.102062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7d31cf-9989-4765-9a76-058b268adcef" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.102195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.102536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.147688] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.147810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.154200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.154672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.154672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.154869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.154911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.154997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.155097] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 is going to be updated. [ 1054.156184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.156357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.156447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.156573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39045f59-5600-413e-a6df-437146897c8f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.194770] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.195032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.195032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.195217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.195431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.195431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef0e22a7-af6f-4355-8779-ca32518594be" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.220906] env[65222]: INFO networking_nsxv3.common.synchronization [None req-72af112c-2bc8-4528-9ebc-ddbab5ff0909 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1054.220906] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1054.221222] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.222036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.240096] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.240096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.240502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.240502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.240502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.240724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934c2ee4-8fd3-4a49-b822-071d800eb172" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.302861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.302861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.303152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.303152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.303691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.335924] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.337887] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: IN_PROGRESS for 2s [ 1054.370310] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.370490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.370584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.374026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.374026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.374026] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 already deleted. [ 1054.374026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.414305] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e05a7a00-b8fe-40b0-96db-3fd1b570f076: rpc.has_security_group_logging(os_id): False [ 1054.440512] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 1054.445225] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1054.447188] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.447373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.447423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.447635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.448608] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 309c514b-b141-440e-916b-43a229296f1d: rpc.has_security_group_logging(os_id): False [ 1054.450076] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 806c8c4c-c741-481d-b9ad-0da164be396a: rpc.has_security_group_logging(os_id): False [ 1054.461362] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deb58d10-eb3b-46ea-87ea-d75bc77a65e2: rpc.has_security_group_logging(os_id): False [ 1054.473108] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1054.473398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.477059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.477228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.479267] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.479405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.480499] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.480589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.482125] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.482341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.482466] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.482739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.482878] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.483038] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 99c9a293-f1e9-4fa0-97ca-4417174da42b not found, creating... [ 1054.483318] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.483471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.483591] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.483830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.483966] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.484285] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.484440] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.484554] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.484764] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.484895] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.485044] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 99c9a293-f1e9-4fa0-97ca-4417174da42b is going to be created. [ 1054.486741] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.486859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.487617] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.487710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.488366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.488588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.488676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.488746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.488924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.489011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.489108] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1054.490382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.490554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.553697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.554050] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.554168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.554322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.554426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.554509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.554634] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309c514b-b141-440e-916b-43a229296f1d is going to be updated. [ 1054.555790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.555961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.559697] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.560069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.560069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.560472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.560558] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.560753] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.580233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.580481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.588375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.588704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.588829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.588898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.589128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.589214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.589416] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.589566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.589566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.589720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.589720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.589965] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.590056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.590123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.590297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.590382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.590525] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1054.591974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.592151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.639025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.639025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.639025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.639025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.640018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.640018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.640018] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1054.640718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.640996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.662754] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.662893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.693772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.694114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.694227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.694305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.694497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.694587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.694687] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1054.695955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.696193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.745346] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.745614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.757867] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.758111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.766673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.767144] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.767330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.767445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.767765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.767921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.768111] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be updated. [ 1054.769530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.769976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.770075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.771188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.771396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.771487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.771644] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27543c2-5369-4055-8e1e-f614903e057b already deleted. [ 1054.771722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.771830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.771980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.772125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.773031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.773185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.773320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.774152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.774313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.774402] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.808696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1054.809531] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1054.810098] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: IN_PROGRESS for 2s [ 1054.839333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.839555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.839555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.839790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.839881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.839982] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be updated. [ 1054.888595] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.888778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.888827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.889147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.889382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.892053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.892186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.892339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.892574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.892716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.916557] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1054.917397] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.917556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.917628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.917803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.917940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.937508] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1054.982878] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.983029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.983097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.983330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.983479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.987706] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: IN_PROGRESS for 2s [ 1055.003353] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1055.230767] env[65222]: INFO networking_nsxv3.common.synchronization [req-8ac6f3c4-9607-4c80-beb3-a0fe4a37aa4a req-d069ba79-ac0f-4307-98c0-49abbd2acaaa service nova] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1055.230877] env[65222]: INFO networking_nsxv3.common.synchronization [req-8ac6f3c4-9607-4c80-beb3-a0fe4a37aa4a req-d069ba79-ac0f-4307-98c0-49abbd2acaaa service nova] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1055.231038] env[65222]: INFO networking_nsxv3.common.synchronization [req-8ac6f3c4-9607-4c80-beb3-a0fe4a37aa4a req-d069ba79-ac0f-4307-98c0-49abbd2acaaa service nova] Enqueued Resource ID: 99c9a293-f1e9-4fa0-97ca-4417174da42b with Priority: HIGHEST for action port [ 1055.231639] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_rules [ 1055.231785] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1055.231883] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c9a293-f1e9-4fa0-97ca-4417174da42b with Priority: HIGHEST for action port [ 1055.235453] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.235453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.235453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.235453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.235693] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.236718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.236718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.236975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-99c9a293-f1e9-4fa0-97ca-4417174da42b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.237145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.237251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.237510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.237631] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99c9a293-f1e9-4fa0-97ca-4417174da42b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.303846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.303944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.307630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.307630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.307630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.307630] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27543c2-5369-4055-8e1e-f614903e057b already deleted. [ 1055.307630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.322706] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c0782c86-4d17-4081-b780-182e5d81d2ff None None] Enqueued Resource ID: 3a15349e-b7c4-4f36-b2d4-186e351bd8e8 with Priority: HIGHEST for action port [ 1055.324838] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a15349e-b7c4-4f36-b2d4-186e351bd8e8 with Priority: HIGHEST for action port [ 1055.325024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a15349e-b7c4-4f36-b2d4-186e351bd8e8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.325157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a15349e-b7c4-4f36-b2d4-186e351bd8e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.325240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a15349e-b7c4-4f36-b2d4-186e351bd8e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.325537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a15349e-b7c4-4f36-b2d4-186e351bd8e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.325618] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a15349e-b7c4-4f36-b2d4-186e351bd8e8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.739595] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.739877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.741219] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99c9a293-f1e9-4fa0-97ca-4417174da42b with status ACTIVE [ 1055.742353] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.742353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.742353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.742503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.742689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.742768] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.742868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.743030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.743094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.743166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.743378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.743483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.743483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.743827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.743916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.743997] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99c9a293-f1e9-4fa0-97ca-4417174da42b is going to be updated. [ 1055.770260] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.770829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.770995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.771255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.771372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.771540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99c9a293-f1e9-4fa0-97ca-4417174da42b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.821238] env[65222]: INFO networking_nsxv3.common.synchronization [req-bd042fbe-22a0-4e37-9572-41511bed9c04 req-03745d9d-63a8-4b10-9bb7-dcfcfeac18e5 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1055.821976] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1055.823153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.823458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.823685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.824428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.824734] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.824914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.825016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.825225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.825348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.825561] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.828260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a15349e-b7c4-4f36-b2d4-186e351bd8e8 [ 1055.828657] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.828790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.828862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.829056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.829147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.829559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a15349e-b7c4-4f36-b2d4-186e351bd8e8 already deleted. [ 1055.829559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a15349e-b7c4-4f36-b2d4-186e351bd8e8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.883903] env[65222]: INFO networking_nsxv3.common.synchronization [req-83e12f5c-c979-4d7a-9e71-eb892bd6ae2c req-dc11eb9b-2637-45bb-8d4d-d3e4c2f13720 tempest-ServersAdminNegativeTestJSON-971697259 tempest-ServersAdminNegativeTestJSON-971697259-project-member] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1055.883903] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1055.883903] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.884537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.886542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.886542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.886542] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.886542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.886876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.887168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.887397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.887505] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.329394] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.353421] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: SUCCESS [ 1056.353640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.392915] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.654697] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.655175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.655499] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.655877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.656740] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.656740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.658030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.658030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.658030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.658030] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.658030] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.658030] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.658030] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.658484] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.658484] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.658484] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.679183] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.679562] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.679647] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.679831] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-773" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.680217] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-60462db8-4515-4010-bf3d-6fe79ea70f59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.680542] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.680542] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.680872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.681032] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60462db8-4515-4010-bf3d-6fe79ea70f59',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.827564] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: SUCCESS [ 1056.827872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.829017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1056.829270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.829807] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1056.829973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.831570] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.895204] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.941948] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1056.941948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.959545] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1056.960511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.001536] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: SUCCESS [ 1057.001536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.014053] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1057.014582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.014732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.015078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.015316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.015437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.015521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.015718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.015798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.015860] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.186589] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.186589] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 60462db8-4515-4010-bf3d-6fe79ea70f59 not found, creating... [ 1057.186589] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.186589] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.187500] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.187500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.187500] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.187665] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.187845] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.188022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 is going to be created. [ 1057.218580] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.218839] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.218963] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.219191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.219503] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.219756] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.338584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.338584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.338584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.338915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.338915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.338915] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1057.384913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.385193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.385305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.385629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.385803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.398658] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1057.399300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.399300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.399300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.399758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.399758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.399758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be updated. [ 1057.431179] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.431306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.431379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.431593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.431742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.445548] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1057.520971] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.945751] env[65222]: INFO networking_nsxv3.common.synchronization [req-bd042fbe-22a0-4e37-9572-41511bed9c04 req-b1624cf3-1fa7-4f6b-bf80-c8f3a88f0495 service nova] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1057.946321] env[65222]: INFO networking_nsxv3.common.synchronization [req-bd042fbe-22a0-4e37-9572-41511bed9c04 req-b1624cf3-1fa7-4f6b-bf80-c8f3a88f0495 service nova] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1057.946321] env[65222]: INFO networking_nsxv3.common.synchronization [req-bd042fbe-22a0-4e37-9572-41511bed9c04 req-b1624cf3-1fa7-4f6b-bf80-c8f3a88f0495 service nova] Enqueued Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1057.946613] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1057.946752] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1057.946863] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1057.947326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.947458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.947528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.947722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.947804] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.948662] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.948825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.948946] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-60462db8-4515-4010-bf3d-6fe79ea70f59 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.949054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.949181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.949298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.949368] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60462db8-4515-4010-bf3d-6fe79ea70f59',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.023416] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.452351] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.452351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.452351] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60462db8-4515-4010-bf3d-6fe79ea70f59 with status ACTIVE [ 1058.452351] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.452351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.452757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.452757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.452757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.452868] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.452947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.453012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.453162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.453690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.453690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.453690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.453690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.453690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.454057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.454057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 is going to be updated. [ 1058.480396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.480396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.480396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.480396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.480396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.480614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.526709] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.526876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.526946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.527181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.527271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.527398] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be updated. [ 1058.598189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.598189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.598189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.598189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.598189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.614186] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1059.343072] env[65222]: INFO networking_nsxv3.common.synchronization [req-f55ce7e0-a60c-436d-a5f9-58e261819886 req-96a91eaa-259c-4112-bdd6-a718bd679d00 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1059.343760] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1059.344905] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.344905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.345044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.345320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.345639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.345828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.345920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.346237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.346237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.346511] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.410612] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1059.411029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.411029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.411264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.411506] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.411634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.411700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.411859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.411955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.412065] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.456349] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1059.456579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.849603] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.915361] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.063620] env[65222]: INFO networking_nsxv3.common.synchronization [req-f0377165-0cff-485b-8214-88563e215263 req-e0efd854-1f3d-4d3a-bd08-7c533683a18b tempest-ListServerFiltersTestJSON-430048906 tempest-ListServerFiltersTestJSON-430048906-project-member] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1060.064428] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGHEST for action security_group_members [ 1060.064846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.064995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.065078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.065321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.065483] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.065588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.065657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.065792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.065868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.065965] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.352450] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.419706] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.568130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.568446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.568603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.568935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.590396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.590725] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.590856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.590919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.591157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.591242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.591332] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be updated. [ 1060.618597] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.618845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.618845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.619044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.619220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1060.624215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.624765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624961] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.625091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.625158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625570] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.626951] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: IN_PROGRESS for 2s [ 1060.855471] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.855471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.855471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.855779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.855779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.855849] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1060.886065] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.886254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.886330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.886585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.886743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.903019] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1060.921716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.921975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.921975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.922390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.922519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.922631] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1060.994677] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.994849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.994922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.995208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.995360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.018391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1061.128626] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.630707] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e3fb04a-0d3f-4197-972f-8af0b18716d2: rpc.has_security_group_logging(os_id): False [ 1061.649301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.649612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.649612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.649766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.675151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.675531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.675680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.675736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.675962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.676076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.676189] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be updated. [ 1061.745396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.745544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.745609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.745859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.745967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.762753] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1062.145321] env[65222]: INFO networking_nsxv3.common.synchronization [req-4cee5f8f-36e2-4c32-9b20-2e4d3055fafb req-597b06cc-a516-44c6-808c-d1764234ff39 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1062.146067] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1062.146455] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.146817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.146817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.147048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.147354] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.147447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.147552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.147799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.147936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.148110] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.494412] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.494412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.494412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.494794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.494951] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.495052] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.495321] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.495377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.495524] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.495985] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.495985] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.495985] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.496181] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.496181] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.496271] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.496406] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.551717] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.551717] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.551717] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.551717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.551717] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-62e935fe-97be-4f0d-b721-f1f24519a7f0 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.551717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.551717] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.553139] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.553540] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e935fe-97be-4f0d-b721-f1f24519a7f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.639984] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 in Status: SUCCESS [ 1062.639984] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 deletion is rescheduled due to dependency. [ 1062.639984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.650260] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.650260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.650501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.650589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.672743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.673025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.673169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.673233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.673478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.673664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.673776] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1062.702438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.702680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.702789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.714880] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1062.913326] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1062.913552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.028613] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1063.028909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.029142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.029419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.029636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.029769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.029841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.030010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.030098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.030176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.030288] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.056889] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.056889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.057111] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.057237] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.057404] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.057556] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 62e935fe-97be-4f0d-b721-f1f24519a7f0 not found, creating... [ 1063.057847] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.058015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.058147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.058416] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.058641] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.058954] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.059132] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.059265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.059551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.059731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.059912] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 62e935fe-97be-4f0d-b721-f1f24519a7f0 is going to be created. [ 1063.087932] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.088364] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.088617] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.089088] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.089495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.089883] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.532731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.532880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.532960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.533368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.533368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.533597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.533597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.533717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.533858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.533941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.534126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.534230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.534495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.534495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.534769] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.534769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.534882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.534929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.535028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.535124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.535212] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.780726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1063.781064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.783110] env[65222]: INFO networking_nsxv3.common.synchronization [req-4cee5f8f-36e2-4c32-9b20-2e4d3055fafb req-f5ba2cc4-ba8d-4efb-9207-ffc8db4acdef service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1063.783252] env[65222]: INFO networking_nsxv3.common.synchronization [req-4cee5f8f-36e2-4c32-9b20-2e4d3055fafb req-f5ba2cc4-ba8d-4efb-9207-ffc8db4acdef service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1063.783389] env[65222]: INFO networking_nsxv3.common.synchronization [req-4cee5f8f-36e2-4c32-9b20-2e4d3055fafb req-f5ba2cc4-ba8d-4efb-9207-ffc8db4acdef service nova] Enqueued Resource ID: 62e935fe-97be-4f0d-b721-f1f24519a7f0 with Priority: HIGHEST for action port [ 1063.783922] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1063.784110] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1063.784176] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e935fe-97be-4f0d-b721-f1f24519a7f0 with Priority: HIGHEST for action port [ 1063.784440] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.784558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.784616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.784842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.784924] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.785976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.786122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.786280] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e935fe-97be-4f0d-b721-f1f24519a7f0 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.786380] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.786448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.786651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.786728] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e935fe-97be-4f0d-b721-f1f24519a7f0',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.037481] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1064.057256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.057432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.057432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.057652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.057652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.058070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.058070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.058070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.058245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.058245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.058391] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.058598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.058654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.058802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.058873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.059090] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.059272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.059272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.059396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.059396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.059569] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1064.136421] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.136682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.136682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.136871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.137030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.152016] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1064.288410] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.288594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.288833] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62e935fe-97be-4f0d-b721-f1f24519a7f0 with status ACTIVE [ 1064.289056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.289229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.289312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.289535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.289627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.289804] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.289899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.289961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.290162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.290269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.290609] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.290729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.290817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.291297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.291297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.291297] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62e935fe-97be-4f0d-b721-f1f24519a7f0 is going to be updated. [ 1064.315012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.315218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.315218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.315472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.315663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.316020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e935fe-97be-4f0d-b721-f1f24519a7f0" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.711384] env[65222]: INFO networking_nsxv3.common.synchronization [req-0488bc76-0287-45c2-bad5-31a7d615d4e9 req-83539ba6-31e2-4f14-b400-4b29116642d5 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1064.711910] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1064.712224] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.716016] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.716016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.716016] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.728072] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1064.728072] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1064.728072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.728072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.728072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.728072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.728390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.728390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.728390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.728390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.728546] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.046243] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d7e2f2a6-ca3b-4f2c-a7fb-2b9c87fc2603 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1065.046889] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1065.047340] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.047340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.047440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.047623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.047772] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.047880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.047944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.048107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.048193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.048286] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.078115] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.078291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.078415] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.078692] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.078948] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.079121] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.079237] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.079486] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.079639] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.079844] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.079955] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.080159] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.080371] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.080499] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.080634] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.080966] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.165195] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.165195] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.082 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.165195] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.165195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.165195] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-4e287589-754b-486f-8cc0-e2ad4426ed2d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.165195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.165195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.165195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.165195] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e287589-754b-486f-8cc0-e2ad4426ed2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.220909] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.220909] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.220909] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 already deleted. [ 1065.220909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.232483] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.554486] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.554486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.554486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.554486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.580102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.580102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.580102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.580102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.580102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.580962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.580962] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1065.612643] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.612785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.612860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.613089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.613230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.624182] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1065.667422] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.667685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.667855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.668374] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.669030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.669030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 4e287589-754b-486f-8cc0-e2ad4426ed2d not found, creating... [ 1065.669030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.669303] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.669303] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.669829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.670774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.670774] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.670774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.670774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.670774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.671048] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.671334] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 4e287589-754b-486f-8cc0-e2ad4426ed2d is going to be created. [ 1065.695051] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.695265] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.695389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.695666] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.695887] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.696129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.736126] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.170496] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1066.170864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.242134] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.242134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.242134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.242565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.242565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.242565] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1066.281891] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.282147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.282147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.282343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.282601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.294186] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [req-0488bc76-0287-45c2-bad5-31a7d615d4e9 req-46cb071f-2514-497a-ba69-a8496c67c6bf service nova] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [req-0488bc76-0287-45c2-bad5-31a7d615d4e9 req-46cb071f-2514-497a-ba69-a8496c67c6bf service nova] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [req-0488bc76-0287-45c2-bad5-31a7d615d4e9 req-46cb071f-2514-497a-ba69-a8496c67c6bf service nova] Enqueued Resource ID: 4e287589-754b-486f-8cc0-e2ad4426ed2d with Priority: HIGHEST for action port [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_rules [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1066.370555] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e287589-754b-486f-8cc0-e2ad4426ed2d with Priority: HIGHEST for action port [ 1066.370555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.370555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.370555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.370555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.370555] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.372255] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.372543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.372801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.373078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.373417] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.373721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.374183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.374859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.374859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.374859] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.376349] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e287589-754b-486f-8cc0-e2ad4426ed2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.378169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.378169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.378169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.378169] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e287589-754b-486f-8cc0-e2ad4426ed2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.876626] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.881090] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e287589-754b-486f-8cc0-e2ad4426ed2d with status ACTIVE [ 1066.881090] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.881090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.881090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.881865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.881865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.881865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.881865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.881865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.881865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.882091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.882091] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.882170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.882479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.882479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.882479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.882595] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e287589-754b-486f-8cc0-e2ad4426ed2d is going to be updated. [ 1066.883710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.884240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.911832] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.912846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.912846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.912846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.912846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.912846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e287589-754b-486f-8cc0-e2ad4426ed2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.111085] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1067.111085] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1067.111473] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1067.111670] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1067.112053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.113096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.113154] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.114084] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.114211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.114270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.114779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.114779] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.114779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.114779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.114971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.115016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.115091] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.161667] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_rules [ 1067.162099] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1067.162265] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1067.162406] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1067.162533] env[65222]: INFO networking_nsxv3.common.synchronization [req-1c620d23-a6db-499f-88ef-57cb236896a9 req-c82d6843-cc73-474f-b9ac-24b8fc4024f4 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1067.162994] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_rules [ 1067.169022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1067.169022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1067.169022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1067.169022] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1067.169022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.169022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.169022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.169022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.169022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.173237] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-60462db8-4515-4010-bf3d-6fe79ea70f59 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.176767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.176767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.176767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.176767] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60462db8-4515-4010-bf3d-6fe79ea70f59',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.176767] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.176767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.176767] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.176767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.379024] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.617308] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.618847] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.634528] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1067.634528] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 deletion is rescheduled due to dependency. [ 1067.634528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.677039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.677219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.677313] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60462db8-4515-4010-bf3d-6fe79ea70f59 with status ACTIVE [ 1067.677541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.677697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.677803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.678128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.678278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.678535] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.678693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.678775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.679410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.679410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.679552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.679690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.679900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.680160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.680281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.680403] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 is going to be updated. [ 1067.681924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.682092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.706356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.706532] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.706579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.706762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.706899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.707075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.882042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.882230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.882230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.882517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.882614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.882739] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 is going to be created. [ 1067.906263] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.906435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.906487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.906671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.906819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.916789] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: UNINITIALIZED for 2s [ 1068.120405] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.122686] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.314107] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1068.314107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.314107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.314107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.314107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.314107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.314935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.314935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.314935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.314935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.314935] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.624216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.624687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.624687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.624839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.625020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.625126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1068.626576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.626714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.626817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.626991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.627410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.627703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be created. [ 1068.667602] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.667774] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.667871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.668108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.668290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.670593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.670770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.670890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.671124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.671310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.684956] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1068.686874] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: UNINITIALIZED for 2s [ 1068.816585] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.816890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.817102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.817420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.817827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.818105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.818231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.818492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.818786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.818990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.819283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.819415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.819582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.819692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.819857] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.819999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.819999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.820191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.820253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.820438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.820530] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.113195] env[65222]: INFO networking_nsxv3.common.synchronization [req-ce040b23-9eb4-49cc-a681-ea051bcc409f req-87c1784f-c622-4e3e-923c-7be66977803f tempest-ServerActionsV293TestJSON-1187284705 tempest-ServerActionsV293TestJSON-1187284705-project-member] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1069.113860] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGHEST for action security_group_members [ 1069.115707] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.115847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.115896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.116137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.116309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.116412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.116476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.116632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.116719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.116817] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.325254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 1069.344300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.344757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.344822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.345053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.346147] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.346147] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.346147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.346474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.346474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.346474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.346669] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.346727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.346797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.346958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.347060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.347169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1069.426303] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.426756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.426907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.427189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.427398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.444742] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1069.619810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.619810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.620063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.620561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.620561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.620723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.620787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.620824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.621762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.621762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621762] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 is going to be updated. [ 1069.657485] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.657485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.657485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.657730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.657946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.671139] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: IN_PROGRESS for 2s [ 1069.931358] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7c234bf-b649-475b-9222-cdf031f86a92 req-e6c995fe-febc-49bb-acd7-b910ab61a4dc tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1069.932926] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: SUCCESS [ 1069.934316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.935096] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1069.935356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.935613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.935865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.936036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.936130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.936347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.936462] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.936579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.936901] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.937914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.938084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.938164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.938438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.938639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.938769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.938853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.939064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.939160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.939289] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.444021] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.444021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.444021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.444021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.444021] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b already deleted. [ 1070.445130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.466440] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.466692] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.466828] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.467242] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.467512] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.467673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.468529] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.468529] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.468529] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.468529] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.468529] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.468769] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.468769] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.468837] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.468895] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.469028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.489257] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.489457] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.489596] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.489769] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.490103] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.490274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.490565] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.490908] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.491091] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc7e169-c6c2-4cd5-a81d-b229c74fc717',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.677819] env[65222]: INFO networking_nsxv3.common.synchronization [req-d78ecac2-fbab-4e79-956e-0238291f27c9 req-a9f7601c-ab00-4904-92d0-c9674e6ce922 tempest-ServersAdminNegativeTestJSON-971697259 tempest-ServersAdminNegativeTestJSON-971697259-project-member] Enqueued Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1070.678415] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 with Priority: HIGHEST for action security_group_members [ 1070.678739] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a055c4f3-b6b2-41d3-9478-9a1e5a156588 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.678864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.678934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.679158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.679318] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.679418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.679476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.679665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.679752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.679845] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a055c4f3-b6b2-41d3-9478-9a1e5a156588',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.696471] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1070.696685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.697101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.697313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.697494] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.697608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.697673] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.697833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.697910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.698012] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.699359] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1070.699574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.700156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.700362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.700538] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.700646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.700709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.700853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.700930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.701031] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.946897] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e1731f5-1d9f-462a-ae44-ca3b648159b6: rpc.has_security_group_logging(os_id): False [ 1070.968603] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.968953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.969021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.969355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.969503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.969912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.970082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.970198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.970494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.970627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.970766] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 is going to be created. [ 1070.994087] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.994335] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.994468] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.994808] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.994965] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.995144] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 not found, creating... [ 1070.995427] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.995626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.995752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.995999] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.996241] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.996909] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.996909] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.996909] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.997368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.997368] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.997368] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 is going to be created. [ 1071.018372] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.018596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.018742] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.019207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.019392] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.019504] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.043024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.043291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.043351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.043771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.043771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.056708] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: IN_PROGRESS for 2s [ 1071.184759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.184759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.184759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.184759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.202602] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.203753] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.213232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.213801] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.213976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.213976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.214193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.214312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.214445] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 is going to be updated. [ 1071.262130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.262365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.262365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.262743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.262938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.275733] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: IN_PROGRESS for 2s [ 1071.461618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1071.462121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.686035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 in Status: SUCCESS [ 1071.686035] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 deletion is rescheduled due to dependency. [ 1071.686035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.709326] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.710606] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.878371] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7c234bf-b649-475b-9222-cdf031f86a92 req-94a5b08b-4502-4f54-8659-e8b1005ec450 service nova] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1071.878556] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7c234bf-b649-475b-9222-cdf031f86a92 req-94a5b08b-4502-4f54-8659-e8b1005ec450 service nova] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1071.878694] env[65222]: INFO networking_nsxv3.common.synchronization [req-d7c234bf-b649-475b-9222-cdf031f86a92 req-94a5b08b-4502-4f54-8659-e8b1005ec450 service nova] Enqueued Resource ID: 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 with Priority: HIGHEST for action port [ 1071.879283] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1071.879425] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1071.879521] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 with Priority: HIGHEST for action port [ 1071.879910] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.880317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.880417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.880641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.880810] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.881664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.881889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.881889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.882083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.882211] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.882347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.882420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.882694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.882825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.882977] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.884017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.884156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.884232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.884442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.884532] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc7e169-c6c2-4cd5-a81d-b229c74fc717',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.215963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.215963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.215963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.215963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.215963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.215963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be updated. [ 1072.216740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.216740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.216740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.216740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.216740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.217074] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1072.262338] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.262615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.262737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.263070] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.263306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.269515] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.270321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.270321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.270735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.270990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.283257] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1072.284361] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1072.386217] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.387140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.387287] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.388461] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 with status ACTIVE [ 1072.388856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.389222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.389222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.389492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.389593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.389821] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.389928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.389991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.390204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.390257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.390552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.390874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.390874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.391012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.391150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.391303] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cc7e169-c6c2-4cd5-a81d-b229c74fc717 is going to be updated. [ 1072.414856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.414967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.415059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.415286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.415439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.415613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc7e169-c6c2-4cd5-a81d-b229c74fc717" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.894421] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.075880] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: SUCCESS [ 1073.076185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.291789] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 in Status: SUCCESS [ 1073.291789] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a055c4f3-b6b2-41d3-9478-9a1e5a156588 deletion is rescheduled due to dependency. [ 1073.292289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a055c4f3-b6b2-41d3-9478-9a1e5a156588" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.397480] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.397825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.398106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.398504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.398660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.398946] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be created. [ 1073.437383] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.438079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.438179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.438476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.439176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.454711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: UNINITIALIZED for 2s [ 1074.102521] env[65222]: INFO networking_nsxv3.common.synchronization [req-59d7df85-8263-4be5-9757-9f212e41cadb req-71d9deff-00f0-4098-b63a-06bf62deb500 tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1074.103148] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1074.103554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.103709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.103781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.104015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.104199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.104306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.104363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.104521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.104617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.104710] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.299036] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1074.299270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.300127] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1074.300292] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.300361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.300695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.300884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.301184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.301184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.301300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.301300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.301430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.301492] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.302760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.302853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.303232] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.303232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.303368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.303439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.303506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.303743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.303743] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.472755] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.472755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.472755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.472755] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.473270] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.473640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.475651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.475651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.475651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.475651] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.475651] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.475651] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.475651] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.475651] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.475651] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.475651] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.500925] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.501121] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.501258] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.501603] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.501751] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-72b6c294-785b-44f5-925d-b77f7719b6ab taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.501921] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.505022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.505022] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.505022] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b6c294-785b-44f5-925d-b77f7719b6ab',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.606714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.606852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.606894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.607255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.607255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.607972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.607972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.607972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.607972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.607972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.608598] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be deleted. [ 1074.651323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.651465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.651560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.651747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.651857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.652128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.805384] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.806570] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.806682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.806754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.806961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.807132] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.807231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.807301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.807453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.807551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.807641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.807860] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.808016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.808885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.809085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.809245] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.810023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.810023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.810023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.810023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.810023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.810023] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.005794] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.006196] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.006329] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.006839] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.007026] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.007212] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 72b6c294-785b-44f5-925d-b77f7719b6ab not found, creating... [ 1075.007469] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.007629] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.007736] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.007973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.008121] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.008410] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.008559] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.008684] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.008888] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.009030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.009169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 72b6c294-785b-44f5-925d-b77f7719b6ab is going to be created. [ 1075.027100] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1075.027100] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1075.027100] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1075.028084] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1075.028180] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1075.028338] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1075.028584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.028717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.028822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.029041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.029214] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.029323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.029385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.029544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.029633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.029720] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.031270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.031395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.031458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.031719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.031881] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.032037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.032111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.032331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.032331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.032421] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.034093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.034223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.034343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.034547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.034690] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.034808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.034808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.034967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.035072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.035235] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.045041] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.045041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.045041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.045041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.045041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.045041] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_rules [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_rules [ 1075.089846] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1075.090211] env[65222]: INFO networking_nsxv3.common.synchronization [req-ac99e084-b19e-4a28-91c7-f489adaccc57 req-d2121ae6-3d20-4a27-b64a-c3cd0ef55782 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1075.090823] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_rules [ 1075.091281] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_rules [ 1075.091339] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1075.091478] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 with Priority: HIGHEST for action port [ 1075.091570] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_rules [ 1075.091663] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1075.091746] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1075.092056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.092188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.092434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.092845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.093087] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.093175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.096239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-60462db8-4515-4010-bf3d-6fe79ea70f59 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.096390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.096498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.096798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.096798] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60462db8-4515-4010-bf3d-6fe79ea70f59',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.097821] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac6861-e4b9-48e8-80f9-d5c31ec1eec5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.097976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.098061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.098312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.098395] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.099378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.099523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.099653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.099728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.312694] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1075.314306] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc553a02-1011-453d-afd5-508e6b6203b1: rpc.has_security_group_logging(os_id): False [ 1075.335114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.335286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.335382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.335579] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.335667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.335900] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.335999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.336085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.336236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.336311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.336397] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be created. [ 1075.338182] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.338342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.338342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.338501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.338601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.338820] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.338922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.338984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.339142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.339216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.339521] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.339521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.339648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.339739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.339817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.339997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.340104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.340157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.340649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.340785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.340876] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1075.441625] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.441858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.441989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.442282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.442566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.465046] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.465216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.465296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.465528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.465679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.473554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1075.473843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.474049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.474345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.475077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.475358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.475420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.475634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.475754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.475879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.476009] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.478513] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1075.519218] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1075.531833] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.534974] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.538313] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.601070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.601318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.601595] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60462db8-4515-4010-bf3d-6fe79ea70f59 with status ACTIVE [ 1075.601834] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.602011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.602126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.602398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.602636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.602884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.603037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.603182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.603400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.603592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.603784] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.603944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.604076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.604277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.604407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.604555] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60462db8-4515-4010-bf3d-6fe79ea70f59 is going to be updated. [ 1075.632554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.632900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.633142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.633437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.633729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.634015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60462db8-4515-4010-bf3d-6fe79ea70f59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.845421] env[65222]: INFO networking_nsxv3.common.synchronization [req-59d7df85-8263-4be5-9757-9f212e41cadb req-fdff4cba-2297-459d-9c13-c8126575b3a6 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1075.845421] env[65222]: INFO networking_nsxv3.common.synchronization [req-59d7df85-8263-4be5-9757-9f212e41cadb req-fdff4cba-2297-459d-9c13-c8126575b3a6 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1075.845626] env[65222]: INFO networking_nsxv3.common.synchronization [req-59d7df85-8263-4be5-9757-9f212e41cadb req-fdff4cba-2297-459d-9c13-c8126575b3a6 service nova] Enqueued Resource ID: 72b6c294-785b-44f5-925d-b77f7719b6ab with Priority: HIGHEST for action port [ 1075.849301] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1075.849301] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1075.849301] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6c294-785b-44f5-925d-b77f7719b6ab with Priority: HIGHEST for action port [ 1075.849301] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.849301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.849301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.849301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.849301] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.849968] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.850273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.850615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.854451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.855045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.855045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.855045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.855045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.855045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.855374] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.856952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-72b6c294-785b-44f5-925d-b77f7719b6ab taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.857195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.857195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.857395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.858031] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b6c294-785b-44f5-925d-b77f7719b6ab',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.978206] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.034932] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.036855] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.039960] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.359729] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.360039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.360151] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.362143] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72b6c294-785b-44f5-925d-b77f7719b6ab with status ACTIVE [ 1076.362143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.362143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.362143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.362782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.362957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.363223] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.363427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.363525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.363764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.363882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.364143] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.365120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.365120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.365120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.365120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.365120] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72b6c294-785b-44f5-925d-b77f7719b6ab is going to be updated. [ 1076.400923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.402696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.402696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.403015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.403421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.403421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72b6c294-785b-44f5-925d-b77f7719b6ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.480577] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b27543c2-5369-4055-8e1e-f614903e057b: rpc.has_security_group_logging(os_id): False [ 1076.504582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.504805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.504871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.505307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.505432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.505860] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.505989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.506142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.506379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.506502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.506599] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be created. [ 1076.537650] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.537843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.537920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.538135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.538240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.538324] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1076.539695] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.539971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.539971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.540146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.540146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.540268] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be updated. [ 1076.541443] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.541581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.541646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.541781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.541864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.541939] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 is going to be created. [ 1076.572081] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.572334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.572397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.572794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.573334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.578168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.578709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.578709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.578926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.578926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.581533] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.581710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.581859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.582104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.582356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.585443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 in Status: UNINITIALIZED for 2s [ 1076.592380] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1076.593097] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1076.616945] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.617363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.617363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.617630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.617831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.631746] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1076.866720] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.369685] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.369958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.370123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.370435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.370605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.370771] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be created. [ 1077.402609] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.402812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.402882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.403085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.403252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.416343] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: UNINITIALIZED for 2s [ 1077.493862] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1077.494299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.495039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.495039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.495039] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.549055] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1077.549299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.549492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.549723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.549813] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.702253] env[65222]: INFO networking_nsxv3.common.synchronization [req-1206da61-51e1-42c1-9318-77117477454e req-dae2e26f-778f-43a1-86d1-858b63611ae7 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1077.702456] env[65222]: INFO networking_nsxv3.common.synchronization [req-1206da61-51e1-42c1-9318-77117477454e req-dae2e26f-778f-43a1-86d1-858b63611ae7 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1077.702628] env[65222]: INFO networking_nsxv3.common.synchronization [req-1206da61-51e1-42c1-9318-77117477454e req-dae2e26f-778f-43a1-86d1-858b63611ae7 tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1077.703615] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1077.703766] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGHEST for action security_group_members [ 1077.703858] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 with Priority: HIGHEST for action security_group_members [ 1077.704580] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.704730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.704881] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.704997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.705155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.705230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.998680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.999040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.052865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.053148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.348257] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.348505] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.349344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.349344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.349344] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.349344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.349646] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.350104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.350104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.350279] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.351024] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.351024] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.351024] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.351024] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.351024] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.351024] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.370863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.371245] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.371245] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.371345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.371640] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-2acc7a75-0029-4604-ba33-6ae31999149e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.371812] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.372121] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.372293] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.372421] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acc7a75-0029-4604-ba33-6ae31999149e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.576408] env[65222]: INFO networking_nsxv3.common.synchronization [req-f2800030-8970-4ed8-9142-d126acd8414f req-2d096012-5891-46e0-8aaf-c9e597d4d397 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1078.576809] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1078.577126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.577268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.577421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.577499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.577653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.577741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.577801] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.577964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.578166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.578166] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.600072] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 in Status: SUCCESS [ 1078.600384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.601426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.601737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.602781] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.602781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.602781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.602781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.602781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.602995] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.610622] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1078.611349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.611869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.612196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.612469] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.612658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.612772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.613050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.613177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.613326] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.616770] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1078.617074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.617898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.617898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.618362] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.618362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.619132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.619132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.619132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.619132] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.645967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1078.646223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.878025] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.878025] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 2acc7a75-0029-4604-ba33-6ae31999149e not found, creating... [ 1078.878025] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.878025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.878703] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.878703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.878703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.878703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.878703] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.878703] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 2acc7a75-0029-4604-ba33-6ae31999149e is going to be created. [ 1078.899855] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.899855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.899855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.900358] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.900629] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.900851] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.080657] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.080886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.080968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.081210] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.081308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.081536] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.081647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.081714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.081881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.081960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.082071] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1079.106937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.107114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.107186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.107406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.107499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.107949] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.107949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.107949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.108137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.108232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.108325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 is going to be deleted. [ 1079.121352] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.121508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.121582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.121795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.121886] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.122097] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.122199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.122259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.122411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.122567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.122689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be updated. [ 1079.124155] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.126072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.126296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.126296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.126452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.126563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.143389] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1079.179025] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.179405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.179511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.179742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.179834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.179948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.180140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.180722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.180722] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.180877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.180877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.181043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.181115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.181295] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.183107] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.183409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.183409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.183606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.183606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.193473] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1079.427719] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1079.428764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.428764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.428764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.428764] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.428764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.429277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.429277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.429277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.429277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.429277] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [req-31b55f7a-ca4a-4a95-8007-06c851b23e58 req-7f17e772-b0d0-432b-a5b0-9039539da9e0 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [req-31b55f7a-ca4a-4a95-8007-06c851b23e58 req-7f17e772-b0d0-432b-a5b0-9039539da9e0 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [req-31b55f7a-ca4a-4a95-8007-06c851b23e58 req-7f17e772-b0d0-432b-a5b0-9039539da9e0 service nova] Enqueued Resource ID: 2acc7a75-0029-4604-ba33-6ae31999149e with Priority: HIGHEST for action port [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1079.612313] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2acc7a75-0029-4604-ba33-6ae31999149e with Priority: HIGHEST for action port [ 1079.612731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.613038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.613232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.613554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.613750] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.619028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.619028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.619028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.619028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.620174] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2acc7a75-0029-4604-ba33-6ae31999149e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.620174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.620174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.620379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.620379] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acc7a75-0029-4604-ba33-6ae31999149e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.628687] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.686721] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.686933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.687066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.687249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.687336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.687561] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.687661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.687715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.687867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.687941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.688037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 already deleted. [ 1079.688117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.688220] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.689048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.689281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.689696] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.689805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.689872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.690994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.691139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.691283] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.931179] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.122624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.122781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.123384] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.123940] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2acc7a75-0029-4604-ba33-6ae31999149e with status ACTIVE [ 1080.125033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.125033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.125033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.126269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.126463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.126700] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.126806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.126874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.127207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.127207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.127369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2acc7a75-0029-4604-ba33-6ae31999149e is going to be updated. [ 1080.132694] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.132881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.132933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.133417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.133417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.133417] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1080.160501] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.160501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.160651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.160875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.161034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.161213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.162214] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.162335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.162405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.162732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.162863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.177118] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1080.195661] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.195661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.195661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.195661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.195661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.195661] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.196103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.196103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.196103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.196103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.196244] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 already deleted. [ 1080.196244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.196423] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deac6861-e4b9-48e8-80f9-d5c31ec1eec5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.434738] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba84537-4aba-48c8-aa91-19210e1c0cf1: rpc.has_security_group_logging(os_id): False [ 1080.453256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.453400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.453473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.453729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.453824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.454134] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.454224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.454282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.454396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.454470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.454559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be created. [ 1080.524034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.524329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.524329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.524480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.524588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.589992] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1080.629485] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.698677] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deac6861-e4b9-48e8-80f9-d5c31ec1eec5: rpc.has_security_group_logging(os_id): False [ 1080.718964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.719198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.719294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.719503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.719610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.719884] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.720011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.720143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.720275] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.720377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.720586] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 is going to be created. [ 1080.746021] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5], does not exist path=[/infra/domains/default/groups/deac6861-e4b9-48e8-80f9-d5c31ec1eec5]."\n}' [ 1080.746153] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5 [ 1080.746245] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1080.786035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.786035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.786035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.786035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.789168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.789168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.789700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.789787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.790058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.790189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.790463] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.791898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.791898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.791898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.791898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.791898] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac6861-e4b9-48e8-80f9-d5c31ec1eec5 is going to be created. [ 1080.816889] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5], does not exist path=[/infra/domains/default/groups/deac6861-e4b9-48e8-80f9-d5c31ec1eec5]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5 [ 1080.817126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac6861-e4b9-48e8-80f9-d5c31ec1eec5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.817841] env[65222]: Traceback (most recent call last): [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1080.817922] env[65222]: return func(*args, **kwargs) [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1080.817922] env[65222]: res.raise_for_status() [ 1080.817922] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1080.817922] env[65222]: raise HTTPError(http_error_msg, response=self) [ 1080.817922] env[65222]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5 [ 1080.817922] env[65222]: During handling of the above exception, another exception occurred: [ 1080.817922] env[65222]: Traceback (most recent call last): [ 1080.817922] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1080.817922] env[65222]: listener.cb(fileno) [ 1080.817922] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1080.817922] env[65222]: result = function(*args, **kwargs) [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1080.817922] env[65222]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1080.817922] env[65222]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1080.817922] env[65222]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1080.817922] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1080.817922] env[65222]: res.raise_for_status() [ 1080.817922] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1080.817922] env[65222]: raise HTTPError(http_error_msg, response=self) [ 1080.817922] env[65222]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/deac6861-e4b9-48e8-80f9-d5c31ec1eec5 [ 1080.817922] env[65222]: Removing descriptor: 65 [ 1081.131952] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.132143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.132218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.132448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.132545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.132728] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1081.156035] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1081.156228] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1081.156351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.171657] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.171850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.171850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.172069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.172216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.181973] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1081.203358] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1081.203549] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 deletion is rescheduled due to dependency. [ 1081.203704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.203881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.204230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.204498] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.204668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.204759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.205015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.205121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.205224] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.708751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.709122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.709122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.709329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.729874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.730024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.730186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.730233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.730453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.730552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.730636] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be updated. [ 1081.756701] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.756701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.756701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.757020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.758473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.767216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1081.979642] env[65222]: INFO networking_nsxv3.common.synchronization [req-6821ee39-f950-4c43-989c-c10d617d3148 req-3f40c01a-fdaf-469e-98d1-666e30bd551d tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1081.980365] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1081.980991] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.980991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.980991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.981251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.981373] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.982497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.982497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.982497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.982497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.982735] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.187886] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1082.188202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.188400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.188646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.188871] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.189053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.189150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.189355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.189458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.189557] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.484997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.485263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.485353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.485609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.512239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.512516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.512657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.512737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.513073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.513181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.513278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1082.546319] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.546512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.546623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.546900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.547382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.560163] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1082.563361] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1082.563615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.691614] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.194793] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1083.195163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.195294] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.196230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.196449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.196674] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.196813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.196882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.197077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.197167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.197257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.197348] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.699631] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.699797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.699842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.700102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.700225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.700329] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1083.701659] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.701813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.701853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.702020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.702167] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.702264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.702326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.702518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.702640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.702695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.702827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.702924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.702985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.703144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.703277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.703367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.703427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.703560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.703634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.703711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.703795] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.733450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.733668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.733668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.733994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.734189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.746625] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1083.776712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1083.776942] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 deletion is rescheduled due to dependency. [ 1083.777112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.777310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.777628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.777888] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.778023] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.778090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.778261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.778341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.778424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.778514] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.206968] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8b0390-6b22-4e1a-92fa-1046e5b93e83: rpc.has_security_group_logging(os_id): False [ 1084.227146] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.227326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.227363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.227589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.262519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.262862] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.262996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.263069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.263283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.263371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.263645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.263720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.263796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.263922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.263998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.264211] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.264307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.264370] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.264512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.264601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.264696] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1084.280581] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.331356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.331356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.331356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.331356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.331356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.353511] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1084.571618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1084.571618] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 1084.572420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.783255] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc553a02-1011-453d-afd5-508e6b6203b1: rpc.has_security_group_logging(os_id): False [ 1084.803572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.803572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.803572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.803572] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be updated. [ 1084.859135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.859312] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.859396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.859645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.859791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.880956] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: IN_PROGRESS for 2s [ 1085.554398] env[65222]: INFO networking_nsxv3.common.synchronization [req-90e1d761-05ea-4141-a781-1b4f616a2057 req-081d7ad3-d8aa-48b1-b32e-9a39ac4e1088 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1085.555574] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1085.556084] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.556444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.556881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.557332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.557926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.557926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.558058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.558265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.558658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.558658] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.757689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1085.757919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.758115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.758364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.758537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.758674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.758730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.759318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.759318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.759318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.759318] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.992032] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.992032] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.992032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.992032] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.992032] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.992032] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.992032] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.992697] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.992697] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.992697] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.011882] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.012081] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1086.012195] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.012365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.012897] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-9622d6b6-2993-4246-bcef-ad0213ce2bbb taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.013149] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.013288] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.013650] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.013913] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9622d6b6-2993-4246-bcef-ad0213ce2bbb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.064093] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.261910] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.262063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.262172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.262356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.262528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.262688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.262755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.262906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.262994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.263167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.263325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.263419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.263478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.263623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.263783] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.263879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.263941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.264092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.264166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.264245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.264331] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.369236] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1086.369236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.517215] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.517429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.517501] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.517769] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.517916] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.518159] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 9622d6b6-2993-4246-bcef-ad0213ce2bbb not found, creating... [ 1086.518441] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.518599] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.518725] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.518974] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.519119] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.519472] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.519687] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.519765] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.519984] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.520175] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.520325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 9622d6b6-2993-4246-bcef-ad0213ce2bbb is going to be created. [ 1086.543036] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.543291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.543366] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.543651] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.543877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.544140] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.566315] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.767261] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e292cc-368f-4af4-9a2c-e739a92ac09e: rpc.has_security_group_logging(os_id): False [ 1086.788537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.788681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.788756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.788960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.809904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.810243] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.810375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.810444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.810712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.810798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.811024] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.811132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.811198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.811347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.811421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.811700] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.811900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.811900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.812105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.812187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.812274] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1086.873384] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.873557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.873656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.873895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.874059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.894343] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1086.895482] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc553a02-1011-453d-afd5-508e6b6203b1 in Status: SUCCESS [ 1086.895482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.069016] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.069016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.069248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.069248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.069618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.069618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1087.071756] env[65222]: INFO networking_nsxv3.common.synchronization [None req-f50d5d1d-54c1-4bc3-a6fe-13f5e9dc3c93 None None] Enqueued Resource ID: 159236de-81ff-4c12-9271-b70c032e6e73 with Priority: HIGHEST for action port [ 1087.072505] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159236de-81ff-4c12-9271-b70c032e6e73 with Priority: HIGHEST for action port [ 1087.073395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-159236de-81ff-4c12-9271-b70c032e6e73 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.073560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-159236de-81ff-4c12-9271-b70c032e6e73" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.073833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-159236de-81ff-4c12-9271-b70c032e6e73" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.073972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-159236de-81ff-4c12-9271-b70c032e6e73" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.074135] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('159236de-81ff-4c12-9271-b70c032e6e73',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.104471] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.104471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.104471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.104471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.104471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.111689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1087.312323] env[65222]: INFO networking_nsxv3.common.synchronization [req-90e1d761-05ea-4141-a781-1b4f616a2057 req-46b6ed23-9160-4828-ad26-89d102ab43cc service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1087.312323] env[65222]: INFO networking_nsxv3.common.synchronization [req-90e1d761-05ea-4141-a781-1b4f616a2057 req-46b6ed23-9160-4828-ad26-89d102ab43cc service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1087.312949] env[65222]: INFO networking_nsxv3.common.synchronization [req-90e1d761-05ea-4141-a781-1b4f616a2057 req-46b6ed23-9160-4828-ad26-89d102ab43cc service nova] Enqueued Resource ID: 9622d6b6-2993-4246-bcef-ad0213ce2bbb with Priority: HIGHEST for action port [ 1087.313081] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1087.313221] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1087.313357] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9622d6b6-2993-4246-bcef-ad0213ce2bbb with Priority: HIGHEST for action port [ 1087.313649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.313771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.313864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.314056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.314138] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.315110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.315156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.315322] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-9622d6b6-2993-4246-bcef-ad0213ce2bbb taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.315595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.315595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.315674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.315748] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9622d6b6-2993-4246-bcef-ad0213ce2bbb',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.578565] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 159236de-81ff-4c12-9271-b70c032e6e73 [ 1087.578565] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.578565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.578565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.578565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.578565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.578565] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:159236de-81ff-4c12-9271-b70c032e6e73 already deleted. [ 1087.578565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-159236de-81ff-4c12-9271-b70c032e6e73" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.817676] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.817676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.817840] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9622d6b6-2993-4246-bcef-ad0213ce2bbb with status ACTIVE [ 1087.817950] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.818088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.818142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.818983] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.818983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.819258] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.819258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.819258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.819474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.819474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.819549] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9622d6b6-2993-4246-bcef-ad0213ce2bbb is going to be updated. [ 1087.840438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.840701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.840783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.840990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.842683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.842931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9622d6b6-2993-4246-bcef-ad0213ce2bbb" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.918194] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1088.919058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.123308] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1089.123509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.123695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.123906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.124105] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.124235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.124299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.124455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.124535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.124633] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.626885] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.130535] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.632448] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.632647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.632760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.633043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.633178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.633318] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1090.671595] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.672309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.672309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.672309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.672488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.694320] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1091.027244] env[65222]: INFO networking_nsxv3.common.synchronization [req-eee370f2-17aa-490e-8c1c-21f484f14677 req-f7b5e5db-6fec-412e-994d-3e7d02c7b2fa tempest-ServersTestJSON-724195664 tempest-ServersTestJSON-724195664-project-member] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1091.027711] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGHEST for action security_group_members [ 1091.028080] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.028227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.028279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.028973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.028973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.028973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.028973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.029291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.029291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.029291] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.531431] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.531871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.531871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.531871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.557817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.557817] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.557817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.557817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.557817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.558767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.558767] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 is going to be updated. [ 1091.587999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.588167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.588778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.589203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.589342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.601737] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: IN_PROGRESS for 2s [ 1092.448522] env[65222]: INFO networking_nsxv3.common.synchronization [req-b50fcf35-8ff6-4ebc-979f-8305f2e66caa req-f37b6c3d-4f99-44ef-9ca2-e8be6d947fcb tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 1092.449132] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGHEST for action security_group_members [ 1092.449516] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.449659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.449722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.449963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.450895] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.451055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.451145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.451335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.451435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.451558] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.705970] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.707358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.707358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.707638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.707638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.707638] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.954375] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.954559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.954654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.955208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.978868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.979162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.979284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.979350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.979567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.979736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.979834] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309c514b-b141-440e-916b-43a229296f1d is going to be updated. [ 1093.017077] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.017576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.017669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.017898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.018057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.030988] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: IN_PROGRESS for 2s [ 1093.210280] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.210469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.210509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.210764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.210935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.211048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.211111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.211268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.211356] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.211503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.211582] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.211674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.211735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.211874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.212013] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.212110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.212169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.212307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.212393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.212494] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.212589] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.551469] env[65222]: INFO networking_nsxv3.common.synchronization [req-b70f1eb5-4b09-4df5-8855-1e99998deb3d req-16b91258-e800-48f0-9005-8c02546c2e6b tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1093.551680] env[65222]: INFO networking_nsxv3.common.synchronization [req-b70f1eb5-4b09-4df5-8855-1e99998deb3d req-16b91258-e800-48f0-9005-8c02546c2e6b tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1093.551843] env[65222]: INFO networking_nsxv3.common.synchronization [req-b70f1eb5-4b09-4df5-8855-1e99998deb3d req-16b91258-e800-48f0-9005-8c02546c2e6b tempest-SecurityGroupsTestJSON-319957562 tempest-SecurityGroupsTestJSON-319957562-project-member] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1093.552869] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGHEST for action security_group_members [ 1093.552869] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGHEST for action security_group_members [ 1093.553058] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGHEST for action security_group_members [ 1093.553224] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.553372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.553456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.553695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.553893] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.554033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.554106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.554298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.554402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.554511] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.555851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.556461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.556461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.556461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.556613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.556613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.556690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.556806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.556888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.556990] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.558428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.558564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.558655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.559126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.559126] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.559126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.559261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.559484] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.559696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.559696] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.613522] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 in Status: SUCCESS [ 1093.613737] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 deletion is rescheduled due to dependency. [ 1093.613885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.714784] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1093.733979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.734146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.734224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.734481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.755332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.755680] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.755809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.755879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.756095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.756181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.756381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.756475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.756899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.756899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.756899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.757059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.757153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.757277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.757495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757495] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1093.828451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.828640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.828737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.829018] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.829209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.844280] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1094.057242] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.057417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.057537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.057797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.057900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.058132] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.061743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.061836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.062061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.062154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.062256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be updated. [ 1094.063773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.063773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.063773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.064010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.065651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.065844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.088105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.088391] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.088511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.088576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.088780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.088859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.088948] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be updated. [ 1094.090181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.090351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.109684] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.109914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.109990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.110239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.110740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.113557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.113818] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.114014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.114141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.114437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.114585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.114744] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be updated. [ 1094.139832] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: IN_PROGRESS for 2s [ 1094.144670] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.144881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.145040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.145335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.145562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.168553] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: IN_PROGRESS for 2s [ 1094.191593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.191593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.191593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.191922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.191922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.199744] env[65222]: INFO networking_nsxv3.common.synchronization [req-49d69b3c-91cc-4767-a20b-6889fa07c34f req-7d31b5e4-b85f-4e96-b759-96b9fe2e72ee tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1094.200296] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1094.200751] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.200932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.201107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.201224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.201390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.201501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.201563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.201722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.201809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.201910] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.208598] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: IN_PROGRESS for 2s [ 1094.661154] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.661365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.661486] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.661757] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.662025] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.662186] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.662300] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.662511] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.662738] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.662927] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.663195] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.663330] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.663476] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.663571] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.663647] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.663780] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.683758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.683945] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.684060] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.684235] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-511" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.684556] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.684724] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.684865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.685253] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.685389] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.705763] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.706291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.706855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1094.740531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.740884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.740995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.741290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.741499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.752805] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1095.044578] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309c514b-b141-440e-916b-43a229296f1d in Status: SUCCESS [ 1095.044910] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309c514b-b141-440e-916b-43a229296f1d deletion is rescheduled due to dependency. [ 1095.045188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.187831] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.188154] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.188292] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.188585] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.188731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.188893] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 not found, creating... [ 1095.189173] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.189328] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.189444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.189658] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.189789] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.190084] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.190240] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.190454] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.190852] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.190852] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.190967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 is going to be created. [ 1095.215365] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.215586] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.215699] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.215997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.216258] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.216501] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.527462] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-266 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.527662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.527797] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.528090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.528347] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.528506] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.528621] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.528844] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.528988] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.529208] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.529321] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.529431] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.529537] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.529643] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.529745] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.529873] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.550097] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.550297] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.550399] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.550632] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-266" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.550965] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-2acc7a75-0029-4604-ba33-6ae31999149e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.551153] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.551274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.551605] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.551749] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acc7a75-0029-4604-ba33-6ae31999149e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.862113] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1095.862431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.911716] env[65222]: INFO networking_nsxv3.common.synchronization [req-49d69b3c-91cc-4767-a20b-6889fa07c34f req-c9106221-c259-4cbf-8c0f-06d09035de87 service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 1095.911994] env[65222]: INFO networking_nsxv3.common.synchronization [req-49d69b3c-91cc-4767-a20b-6889fa07c34f req-c9106221-c259-4cbf-8c0f-06d09035de87 service nova] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1095.912236] env[65222]: INFO networking_nsxv3.common.synchronization [req-49d69b3c-91cc-4767-a20b-6889fa07c34f req-c9106221-c259-4cbf-8c0f-06d09035de87 service nova] Enqueued Resource ID: 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 with Priority: HIGHEST for action port [ 1095.912951] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_rules [ 1095.913159] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1095.913320] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 with Priority: HIGHEST for action port [ 1095.913712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.914536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.914536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.914536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.914536] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.915502] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.915629] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.915890] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.916038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.916133] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.916371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.916478] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.054517] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.054745] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.054872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.055191] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.055341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.055637] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.056140] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.056438] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.056595] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.056947] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.057160] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.057359] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.057587] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.057803] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.057972] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 2acc7a75-0029-4604-ba33-6ae31999149e is going to be updated. [ 1096.080843] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.081072] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.081198] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.081467] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.081657] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.081885] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.152115] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e in Status: SUCCESS [ 1096.152313] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e deletion is rescheduled due to dependency. [ 1096.152429] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.179867] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 806c8c4c-c741-481d-b9ad-0da164be396a in Status: SUCCESS [ 1096.180091] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a deletion is rescheduled due to dependency. [ 1096.180212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.217792] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 in Status: SUCCESS [ 1096.218059] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 deletion is rescheduled due to dependency. [ 1096.218181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.418877] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.419030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.419263] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 with status ACTIVE [ 1096.419453] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.419581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.419653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.419884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.419952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.420112] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.420280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.420280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.420397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.420488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.420666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.420751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.420843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.421038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.421124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.421254] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3 is going to be updated. [ 1096.443828] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.443911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.443988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.444213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.444349] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.444545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d0bedfc-6861-4520-8eb1-bbe7eaa4edc3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.763453] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1096.763633] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 1096.763754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.763945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.764188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.764368] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.764485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.764553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.764851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.764971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.765089] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.771180] env[65222]: INFO networking_nsxv3.common.synchronization [req-69ecee5b-8757-4ecc-bfc0-68c0685adfc2 req-d468f24f-b56e-43bd-9cb0-c7f8bf726428 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 1096.771439] env[65222]: INFO networking_nsxv3.common.synchronization [req-69ecee5b-8757-4ecc-bfc0-68c0685adfc2 req-d468f24f-b56e-43bd-9cb0-c7f8bf726428 service nova] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1096.771754] env[65222]: INFO networking_nsxv3.common.synchronization [req-69ecee5b-8757-4ecc-bfc0-68c0685adfc2 req-d468f24f-b56e-43bd-9cb0-c7f8bf726428 service nova] Enqueued Resource ID: 2acc7a75-0029-4604-ba33-6ae31999149e with Priority: HIGHEST for action port [ 1096.771754] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_rules [ 1096.771896] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1096.772057] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2acc7a75-0029-4604-ba33-6ae31999149e with Priority: HIGHEST for action port [ 1096.772609] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.772817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.772817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.772987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.773142] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.773995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.774129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.774197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.774426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.775364] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.775364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.775364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.775364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.775364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.775364] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.775807] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2acc7a75-0029-4604-ba33-6ae31999149e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.776153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.776153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.776153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.776269] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acc7a75-0029-4604-ba33-6ae31999149e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.267209] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.278036] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.279278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.279779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.279965] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2acc7a75-0029-4604-ba33-6ae31999149e with status ACTIVE [ 1097.280203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.280352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.280426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.280743] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.281428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.281428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.281428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.281428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.281612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.281824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.281883] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.281985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.282062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.282211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.282288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.282436] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2acc7a75-0029-4604-ba33-6ae31999149e is going to be updated. [ 1097.303579] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.303764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.303829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.303995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.304147] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.304316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2acc7a75-0029-4604-ba33-6ae31999149e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.769604] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.784666] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.274919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.275195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.275195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.275679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.275679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.275679] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1098.287599] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.287761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.287837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.288099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.288376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.288376] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1098.306502] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.306644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.306716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.306925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.307085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.317260] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1098.324651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.324651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.324651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.324825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.324958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.333541] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1098.412898] env[65222]: INFO networking_nsxv3.common.synchronization [req-33bbe534-1ed6-44f0-b89d-5a9e154bbcfd req-925e9135-4775-482e-afb8-71da129b5152 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1098.413317] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1098.413634] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.413769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.414038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.414038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.417042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.417042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.417042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.417042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.417042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.417042] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.808101] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.808243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.808281] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.808549] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.808805] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.808956] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.809332] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.809576] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.809727] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.809942] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.810068] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.810179] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.810287] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.810395] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.810499] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.810643] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.829300] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.829514] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.829655] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.829830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-997" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.830164] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-bcb008e6-c617-4eee-8586-bf27d82bdaca taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.830334] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.830450] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.830992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.831150] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb008e6-c617-4eee-8586-bf27d82bdaca',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.921633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.922010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.922010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.922204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.951399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.951707] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.951981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.952093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.952320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.952390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.952492] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1098.981203] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.981369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.981480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.981627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.981760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.993534] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1099.333386] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.333765] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.333805] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.334253] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.334336] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.334597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port bcb008e6-c617-4eee-8586-bf27d82bdaca not found, creating... [ 1099.334892] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.335050] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.335163] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.335402] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.335574] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.335898] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.336075] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.336201] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.336439] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.336581] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.336732] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: bcb008e6-c617-4eee-8586-bf27d82bdaca is going to be created. [ 1099.363779] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.363997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.364138] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.364406] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.364627] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.364849] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.114034] env[65222]: INFO networking_nsxv3.common.synchronization [req-33bbe534-1ed6-44f0-b89d-5a9e154bbcfd req-9fd4baa1-a614-46d5-9b8d-fd8e229e0b71 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1100.114034] env[65222]: INFO networking_nsxv3.common.synchronization [req-33bbe534-1ed6-44f0-b89d-5a9e154bbcfd req-9fd4baa1-a614-46d5-9b8d-fd8e229e0b71 service nova] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1100.114165] env[65222]: INFO networking_nsxv3.common.synchronization [req-33bbe534-1ed6-44f0-b89d-5a9e154bbcfd req-9fd4baa1-a614-46d5-9b8d-fd8e229e0b71 service nova] Enqueued Resource ID: bcb008e6-c617-4eee-8586-bf27d82bdaca with Priority: HIGHEST for action port [ 1100.114716] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_rules [ 1100.114853] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1100.114955] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb008e6-c617-4eee-8586-bf27d82bdaca with Priority: HIGHEST for action port [ 1100.117800] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.117958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.118024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.118257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.118315] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.119204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.119340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.119500] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb008e6-c617-4eee-8586-bf27d82bdaca taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.119615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.119657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.119833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.119905] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb008e6-c617-4eee-8586-bf27d82bdaca',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.327968] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1100.327968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.327968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.327968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.328358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.328358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.328358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.328552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.328552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.328631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.328670] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.343384] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1100.343839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.343839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.344123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.344337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.344465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.344541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.344741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.344790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.344857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.344945] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.622861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.623171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.624731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb008e6-c617-4eee-8586-bf27d82bdaca with status ACTIVE [ 1100.624731] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.624983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.625052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.625254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.625414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.625800] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.625800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.625800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.626230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.626230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.626230] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.626393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.626423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.626602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.626698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.626799] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb008e6-c617-4eee-8586-bf27d82bdaca is going to be updated. [ 1100.658816] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.658816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.658816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.658816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.659124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.659124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb008e6-c617-4eee-8586-bf27d82bdaca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.831237] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.831237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.831444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.831522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.832092] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.832251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.832332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.832507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.832607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.832930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.832930] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.833028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.833057] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.833214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.833390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.833486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.833547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.833701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.833811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.833905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.833997] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.846843] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.847055] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.847236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.847390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.847672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.847735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.847867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.847953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.848838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.848838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.848838] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.848838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.848838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.848838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.849103] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.849103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.849199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.849383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.849458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.849541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.849639] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.004692] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1101.005418] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1101.005418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.005418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.005654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.005846] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.005960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.006036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.006200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.006301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.006369] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.339070] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb5605d-d158-4afb-b319-53f3e5ce181c: rpc.has_security_group_logging(os_id): False [ 1101.356689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8b0390-6b22-4e1a-92fa-1046e5b93e83: rpc.has_security_group_logging(os_id): False [ 1101.357927] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.357927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.357927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.357927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.357927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.358174] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.358174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.358174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.358261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.358335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.358523] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.358959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.358959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.358959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.358959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.359337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.359337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.359337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.359337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.359467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.359467] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1101.371223] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.371223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.371223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.371223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.371524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.371583] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.372409] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.372509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.372930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.372930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.373037] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.373111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.373222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.373348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.373408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.373627] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.373733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.373795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.374212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.374212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.374212] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1101.428114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.430134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.430134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.430134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.430134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.447360] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.447557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.447662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.447941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.448183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.452634] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1101.463340] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1101.510637] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.014625] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.517826] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.518121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.518121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.518284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.518381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.518485] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1102.548864] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.548864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.548864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.549142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.550115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.559388] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1102.732950] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e0eaa7af-10f9-4422-a455-5cdc583bd20e None None] Enqueued Resource ID: 0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867 with Priority: HIGHEST for action port [ 1102.732950] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867 with Priority: HIGHEST for action port [ 1102.733230] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.733307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.733364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.733614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.733700] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.884761] env[65222]: INFO networking_nsxv3.common.synchronization [None req-c5b001a0-2523-4da7-b758-182a3fbd48c2 tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1102.884761] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1102.884761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.885156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.885335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.885678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.885860] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.038506] env[65222]: INFO networking_nsxv3.common.synchronization [None req-daa53704-c270-46f0-92a2-2180ac88fe68 tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1103.039019] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1103.039327] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.039465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.237037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867 [ 1103.237332] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.238140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.238140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.238140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.238326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.238354] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867 already deleted. [ 1103.238496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ec3cfa2-3e89-4fdb-95ab-58d4e95ee867" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.408874] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.409137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.409243] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.410120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.410335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.410514] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e already deleted. [ 1103.410654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.410915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.411529] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.411694] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.475340] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1103.475896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.481268] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1103.481268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.936706] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.936706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.936706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.936706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.936706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.936706] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e already deleted. [ 1103.936706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.574276] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1104.574276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.574486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.575710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.575710] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.575710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.575921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.575921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.576021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.576104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.576184] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.610311] env[65222]: INFO networking_nsxv3.common.synchronization [req-9cfae5ce-e73c-40eb-b6d1-7d62bc522b4e req-7fcafb28-1b1e-4b00-b241-a7e5fb4e32ae tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1104.611510] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1104.612212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.612212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.612829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.612829] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.612829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.612999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.612999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.613119] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.073107] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.073521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.073521] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.074997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.074997] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.076107] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.076678] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.076678] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.077229] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.077567] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.077876] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.079800] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.079800] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.079800] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.079800] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.079959] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.081464] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.081567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.083393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.083393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.083741] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.083849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.083916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.084102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.084187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.084276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.086555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.086555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.086555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.086555] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.107407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.107407] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.107407] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.107407] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.107407] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.107407] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.107663] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.108620] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.108620] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e95eb29-39a5-42ab-b213-98b5e8bc1d70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.115378] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.589216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 034ec8fb-de90-4302-acab-f4bec595dd2d: rpc.has_security_group_logging(os_id): False [ 1105.613354] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.613354] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 not found, creating... [ 1105.613354] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.613354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.613838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.613838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.613914] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.614876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.614976] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.615326] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.615481] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.615631] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 is going to be created. [ 1105.617984] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.618174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.618266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.618464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.618527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.618749] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.618836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.618891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.619049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.619122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.619305] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.619398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.619451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.619601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.619666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.619865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.619971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.620032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.620185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.620266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.620389] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1105.621837] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.646391] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.646391] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.646620] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.647409] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.647519] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.647779] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.696459] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.696642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.696751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.697607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.697607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.730982] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1105.973588] env[65222]: INFO networking_nsxv3.common.synchronization [None req-480049d8-65a7-4860-b93d-1129fce8ce4f None None] Enqueued Resource ID: 3bcc03da-8b36-4f78-bb69-38dff780d19a with Priority: HIGHEST for action port [ 1105.974186] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcc03da-8b36-4f78-bb69-38dff780d19a with Priority: HIGHEST for action port [ 1105.974495] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bcc03da-8b36-4f78-bb69-38dff780d19a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.974617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bcc03da-8b36-4f78-bb69-38dff780d19a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.974683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bcc03da-8b36-4f78-bb69-38dff780d19a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.974951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bcc03da-8b36-4f78-bb69-38dff780d19a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.975044] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bcc03da-8b36-4f78-bb69-38dff780d19a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.125014] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.125422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.125422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.125794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.125794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.125794] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1106.163441] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.163441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.163441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.163441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.163441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.172340] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1106.426015] env[65222]: INFO networking_nsxv3.common.synchronization [req-9cfae5ce-e73c-40eb-b6d1-7d62bc522b4e req-c165968c-29bb-451f-9330-11de5f9aa04e service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1106.427956] env[65222]: INFO networking_nsxv3.common.synchronization [req-9cfae5ce-e73c-40eb-b6d1-7d62bc522b4e req-c165968c-29bb-451f-9330-11de5f9aa04e service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1106.427956] env[65222]: INFO networking_nsxv3.common.synchronization [req-9cfae5ce-e73c-40eb-b6d1-7d62bc522b4e req-c165968c-29bb-451f-9330-11de5f9aa04e service nova] Enqueued Resource ID: 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 with Priority: HIGHEST for action port [ 1106.427956] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1106.427956] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1106.427956] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 with Priority: HIGHEST for action port [ 1106.427956] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.427956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.427956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.428476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.428476] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.430227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.430486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.430734] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.431477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.431477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.431477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.431477] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e95eb29-39a5-42ab-b213-98b5e8bc1d70',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.477813] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3bcc03da-8b36-4f78-bb69-38dff780d19a [ 1106.478070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.478232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.478308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.478553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.478627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.478726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3bcc03da-8b36-4f78-bb69-38dff780d19a already deleted. [ 1106.478805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bcc03da-8b36-4f78-bb69-38dff780d19a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.931094] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.931247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.933653] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 with status ACTIVE [ 1106.933842] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.933955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.934038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.934248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.934336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.934513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.934612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.934670] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.934827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.934903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.935102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.935863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.935863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.935863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.935863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.935863] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e95eb29-39a5-42ab-b213-98b5e8bc1d70 is going to be updated. [ 1106.957350] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.957531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.957598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.957755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.957891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.958074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e95eb29-39a5-42ab-b213-98b5e8bc1d70" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.748291] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1107.748602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.038636] env[65222]: INFO networking_nsxv3.common.synchronization [req-2ba81c03-19fe-45cc-90b0-f0f8751c9ae8 req-c9b372e4-5af9-4941-8827-28cb4b60b950 tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 1108.038906] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 1108.039322] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.039483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.039483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.039715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.039888] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.039992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.040061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.040265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.040394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.040500] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.182215] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1108.182434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.183067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.183290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.183472] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.183603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.183726] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.183904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.183983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.184341] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.542982] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.687574] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.045729] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.070624] env[65222]: INFO networking_nsxv3.common.synchronization [req-fa28fbc8-d4b5-4525-86e3-7ea1802eca30 req-634b3b16-c3af-4743-8677-5aba9e9fbf20 tempest-ServerDiskConfigTestJSON-1251201298 tempest-ServerDiskConfigTestJSON-1251201298-project-member] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1109.071839] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGHEST for action security_group_members [ 1109.071974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.072611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.072611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.076017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.076017] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.076017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.076017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.076017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.076017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.076017] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.189893] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.548545] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.548703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.548835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.549093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.549224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.549526] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be updated. [ 1109.575429] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.575567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.575567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.575755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.575828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.576072] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.576205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.576205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.576352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.576403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.576479] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be updated. [ 1109.586284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.586637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.586637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.586893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.587150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.597564] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 1109.609284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.609480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.609535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.610052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.610256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.622418] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: IN_PROGRESS for 2s [ 1109.695599] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.695848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.695902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.696181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.696339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.696473] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1109.732027] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.732027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.732027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.732027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.732027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.746092] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1109.878415] env[65222]: INFO networking_nsxv3.common.synchronization [req-6bc7b662-9b96-48e2-ae7c-2fcdadc23c8e req-f4e81dd5-6f43-4b98-baae-7efa3b3cd55d tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1109.878962] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1109.879280] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.879399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.879468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.880022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.880191] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.880296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.880519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.880519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.880595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.880690] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.332736] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.333219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.333219] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.333393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.334509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.334509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.334828] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.334971] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.335193] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.335419] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.335527] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.335632] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.335736] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.335844] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.335947] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.336094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.357288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.357288] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.357425] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.358033] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.358033] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.358033] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.358216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.358512] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.359085] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1e7ed5-c66b-48c1-809f-6e2febcdc4da',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.385266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.385418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.385482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.386097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.387021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.387021] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.387021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.387021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.387268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.387345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.387497] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e already deleted. [ 1110.387633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.861785] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.862896] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.863127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.863518] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.863740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.863997] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da not found, creating... [ 1110.864437] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.864672] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.864856] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.865229] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.865436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.865841] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.866090] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.866282] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.866608] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.866829] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.867062] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da is going to be created. [ 1110.888806] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.889150] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.889264] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.889612] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.889854] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.890132] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.608022] env[65222]: INFO networking_nsxv3.common.synchronization [req-6bc7b662-9b96-48e2-ae7c-2fcdadc23c8e req-bd2ab1f1-cde6-4283-89ea-fce507e0fc67 service nova] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1111.608022] env[65222]: INFO networking_nsxv3.common.synchronization [req-6bc7b662-9b96-48e2-ae7c-2fcdadc23c8e req-bd2ab1f1-cde6-4283-89ea-fce507e0fc67 service nova] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1111.608022] env[65222]: INFO networking_nsxv3.common.synchronization [req-6bc7b662-9b96-48e2-ae7c-2fcdadc23c8e req-bd2ab1f1-cde6-4283-89ea-fce507e0fc67 service nova] Enqueued Resource ID: 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da with Priority: HIGHEST for action port [ 1111.609542] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_rules [ 1111.609935] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1111.612621] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da with Priority: HIGHEST for action port [ 1111.612621] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 1111.612621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.612621] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.612621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.612621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.612621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.612621] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.615076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.615856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.616059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.616372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.617300] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.617300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.617300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.617506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.617506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.617984] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.619451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.619451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.619451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.619770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.619770] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1e7ed5-c66b-48c1-809f-6e2febcdc4da',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.635147] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c in Status: SUCCESS [ 1111.635412] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c deletion is rescheduled due to dependency. [ 1111.635612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.758393] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1111.758894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.759097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.759341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.759540] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.759662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.759729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.759895] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.759981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.760080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.760172] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.115930] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.115930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.119403] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.121838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da with status ACTIVE [ 1112.121838] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.121838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.122046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.122113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.122262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.122396] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.122497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.122560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.122718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.122796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.123029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.123261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.123261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.123369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.123428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.123488] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e1e7ed5-c66b-48c1-809f-6e2febcdc4da is going to be updated. [ 1112.144531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.144725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.144763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.144948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.145102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.145265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e1e7ed5-c66b-48c1-809f-6e2febcdc4da" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.262819] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.262995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.263089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.264085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.264085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.264434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.264434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.264434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.264584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.264710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.264822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.264949] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.265090] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.621894] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.767693] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1112.790584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.790822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.791022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.791279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.791374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.791655] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.791744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.791744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.791905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.791980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.792186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.792280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.792341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.792524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.792565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.792777] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.792909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.792956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.793111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.793179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.793269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1112.861216] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.861434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.862028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.862028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.862028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.881460] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1113.085276] env[65222]: INFO networking_nsxv3.common.synchronization [req-a340b49f-49d6-4691-a9fb-170df627ca2b req-cf1e4c0b-7a0f-49ac-b4af-f4340002a41b tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1113.086176] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1113.088420] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.088420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.088420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.088684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.088775] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.088907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.088990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.089328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.089404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.089550] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.124810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.124968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.125207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.125443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.125535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.125640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e is going to be created. [ 1113.167051] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.167271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.167271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.167472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.167712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.186386] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: UNINITIALIZED for 2s [ 1113.595454] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.099545] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.602660] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.602660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.602660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.602952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.603400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.603400] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be updated. [ 1114.632434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.632434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.632669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.632869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.633072] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.643905] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1114.902339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1114.902978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.978334] env[65222]: INFO networking_nsxv3.common.synchronization [req-45e2ac99-1f3e-4b65-b742-9e756f24ee12 req-b57f72fb-e02c-424b-9b71-14a7718f0f0a tempest-ServerRescueNegativeTestJSON-1673636724 tempest-ServerRescueNegativeTestJSON-1673636724-project-member] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 1114.978976] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGHEST for action security_group_members [ 1114.981426] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.981587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.981708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.982034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.982218] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.982390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.982558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.983592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.983710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.983819] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.196894] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: SUCCESS [ 1115.197406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.197406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.197406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.197640] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.197736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.197736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.197893] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.197969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.198046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.198145] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.486743] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.486913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.486913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.487160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.508992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.509133] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.509202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.509300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.509471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.509570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.509646] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be updated. [ 1115.535720] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.535869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.536019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.536148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.536294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.546540] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: IN_PROGRESS for 2s [ 1115.700307] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.202989] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac028803-c2f2-4ce0-97e9-bd69f4396d9e: rpc.has_security_group_logging(os_id): False [ 1116.228995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.229605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.230026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.230832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.230832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.231161] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.231250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.231400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.231679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.231827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.232037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e is going to be created. [ 1116.368393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.368393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.368393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.368393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.368393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.398463] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: IN_PROGRESS for 2s [ 1116.655781] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1116.656039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.370253] env[65222]: INFO networking_nsxv3.common.synchronization [req-4c9c27dc-3f3c-4d65-8b79-63dcdd7cdd6d req-4667622b-a4ca-4eec-834d-70e20c050a9a tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1117.370838] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1117.371165] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.371288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.371354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.371561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.371718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.371819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.371879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.372038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.372124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.372216] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.559103] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1afa0b0-3cbd-4920-98be-230a695a0592 in Status: SUCCESS [ 1117.559257] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 deletion is rescheduled due to dependency. [ 1117.559296] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.876053] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.379457] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.413395] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: SUCCESS [ 1118.413631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.881548] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.881707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.881780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.882020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.882108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.882209] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1118.912980] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.913182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.913257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.913470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.913614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.924558] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1120.807690] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4ab45982-aa1b-4378-8628-d61eda600f7c None None] Enqueued Resource ID: 4be36db5-3638-4ebf-8423-0bd3396f0b38 with Priority: HIGHEST for action port [ 1120.808318] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be36db5-3638-4ebf-8423-0bd3396f0b38 with Priority: HIGHEST for action port [ 1120.808711] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be36db5-3638-4ebf-8423-0bd3396f0b38 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.808853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be36db5-3638-4ebf-8423-0bd3396f0b38" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.808929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be36db5-3638-4ebf-8423-0bd3396f0b38" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.809658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be36db5-3638-4ebf-8423-0bd3396f0b38" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.809658] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be36db5-3638-4ebf-8423-0bd3396f0b38',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.938940] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1120.939069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.312557] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4be36db5-3638-4ebf-8423-0bd3396f0b38 [ 1121.312644] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.312780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.313412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.313412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.313412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.313555] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4be36db5-3638-4ebf-8423-0bd3396f0b38 already deleted. [ 1121.313612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be36db5-3638-4ebf-8423-0bd3396f0b38" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.833588] env[65222]: INFO networking_nsxv3.common.synchronization [None req-612f23e7-ce10-4ad0-81b8-f1d903f757fb tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1121.834739] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1121.834914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.835036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.835334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.835395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.835935] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.942539] env[65222]: INFO networking_nsxv3.common.synchronization [None req-924acf43-f5da-485e-88e4-ca3c57575d56 tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1121.943615] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1121.943615] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.943615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.359385] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.359922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.359922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.359922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.360333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.360333] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b already deleted. [ 1122.360333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.360519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.360561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.360623] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.809125] env[65222]: INFO networking_nsxv3.common.synchronization [None req-945837cc-ebe1-4942-a5d5-c1791d8c6674 None None] Enqueued Resource ID: 3294743a-889d-4176-85bc-9d068f8bb85e with Priority: HIGHEST for action port [ 1122.809125] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3294743a-889d-4176-85bc-9d068f8bb85e with Priority: HIGHEST for action port [ 1122.809125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3294743a-889d-4176-85bc-9d068f8bb85e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.809125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3294743a-889d-4176-85bc-9d068f8bb85e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.809125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3294743a-889d-4176-85bc-9d068f8bb85e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.810107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3294743a-889d-4176-85bc-9d068f8bb85e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.810219] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3294743a-889d-4176-85bc-9d068f8bb85e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.883085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.883398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.883398] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.883571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.883663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.883871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b already deleted. [ 1122.883871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.312578] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3294743a-889d-4176-85bc-9d068f8bb85e [ 1123.315871] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.315871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.315871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.315871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.315871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.315871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3294743a-889d-4176-85bc-9d068f8bb85e already deleted. [ 1123.315871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3294743a-889d-4176-85bc-9d068f8bb85e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.418487] env[65222]: INFO networking_nsxv3.common.synchronization [req-8081b1d7-1749-47a8-a78d-529aa73e0b14 req-1b57c528-92d0-4b54-b68e-6a2896b85986 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1123.419689] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGHEST for action security_group_members [ 1123.419689] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.419689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.419689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.419864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.419983] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.420265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.420265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.420378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.420378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.420475] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.923509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.923805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.923805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.924832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.945447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.945714] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.945834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.945932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.946112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.946196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.946290] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be updated. [ 1123.976652] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.976652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.976652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.976652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.976652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.986935] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: IN_PROGRESS for 2s [ 1125.998253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 in Status: SUCCESS [ 1125.998737] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 deletion is rescheduled due to dependency. [ 1125.998737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.500374] env[65222]: INFO networking_nsxv3.common.synchronization [req-414d63e0-9566-4c51-87ff-eaca0be9950e req-39412cdc-cd03-43ed-8e15-648cafd987ad tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1126.501039] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1126.501326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.501446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.501630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.501811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.502031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.502160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.502264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.502490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.502580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.502677] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.584153] env[65222]: INFO networking_nsxv3.common.synchronization [req-1862d71b-8572-4a7c-a8d7-4f450846bd7d req-567f0ba2-21c6-41b9-9e64-5722e6f5d7f0 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1126.584153] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1126.584153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.584153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.585333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.585614] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.586020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.586562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.586562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.587563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.587704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.587842] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.884153] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.884429] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.884588] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.884891] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.885215] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.885418] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.885552] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.885765] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.885909] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.886128] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.886242] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.886353] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.886460] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.886565] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.886666] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.886796] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.905971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.906194] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.906332] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.906497] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.906784] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-cbbbd412-892f-40e7-982a-5d8842c9201b taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.906949] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.907079] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.907389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.907515] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbbbd412-892f-40e7-982a-5d8842c9201b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.005020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.005377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.005377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.005459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.005553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.005760] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.005939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.006010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.006333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.006443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.006758] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f already deleted. [ 1127.006875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.090337] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.409836] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.409836] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.409836] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.410129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.410267] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.410425] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port cbbbd412-892f-40e7-982a-5d8842c9201b not found, creating... [ 1127.410672] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.410825] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.410954] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.411188] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.411320] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.411597] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.411746] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.411862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.412085] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.412216] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.412352] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: cbbbd412-892f-40e7-982a-5d8842c9201b is going to be created. [ 1127.432471] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.432662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.432771] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.433108] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.433348] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.433569] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.592530] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.096306] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.096862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.096862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.096862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.096862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.096995] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1128.125660] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.125795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.125884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.126139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.126284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.135082] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1128.148198] env[65222]: INFO networking_nsxv3.common.synchronization [req-414d63e0-9566-4c51-87ff-eaca0be9950e req-cf9556c2-962e-4968-b53b-e452ac9b17ab service nova] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_rules [ 1128.148363] env[65222]: INFO networking_nsxv3.common.synchronization [req-414d63e0-9566-4c51-87ff-eaca0be9950e req-cf9556c2-962e-4968-b53b-e452ac9b17ab service nova] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1128.148493] env[65222]: INFO networking_nsxv3.common.synchronization [req-414d63e0-9566-4c51-87ff-eaca0be9950e req-cf9556c2-962e-4968-b53b-e452ac9b17ab service nova] Enqueued Resource ID: cbbbd412-892f-40e7-982a-5d8842c9201b with Priority: HIGHEST for action port [ 1128.149042] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_rules [ 1128.149175] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1128.149273] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbbbd412-892f-40e7-982a-5d8842c9201b with Priority: HIGHEST for action port [ 1128.149581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.149653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.149719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.149977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.150158] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.151078] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.151251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.151320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.151490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.151935] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.151935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.151935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.151935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.152154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.152154] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.153272] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbbbd412-892f-40e7-982a-5d8842c9201b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.153382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.153448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.153598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.153673] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbbbd412-892f-40e7-982a-5d8842c9201b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.655051] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.655245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.655319] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.656269] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbbbd412-892f-40e7-982a-5d8842c9201b with status ACTIVE [ 1128.656461] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.656576] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.656643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.656890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.656997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.657109] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.657198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.657291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.657441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.657564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.657752] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.657882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.657927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.658053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.658130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.658214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbbbd412-892f-40e7-982a-5d8842c9201b is going to be updated. [ 1128.679653] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.679880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.679880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.680064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.680199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.680351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbbbd412-892f-40e7-982a-5d8842c9201b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.159991] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.662597] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.662757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.662821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.663079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.663200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.663306] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be created. [ 1129.688851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.689062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.689149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.689424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.689590] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.701173] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: UNINITIALIZED for 2s [ 1129.850372] env[65222]: INFO networking_nsxv3.common.synchronization [req-ae4ba783-5a8f-4b8c-ab91-4c07548a92c0 req-fd785ee9-3479-425b-881b-305b3322049a tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1129.850372] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1129.850549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.850675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.850742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.851815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.851815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.851815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.851815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.851815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.851815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.851815] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.145909] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1130.146335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.191977] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.192345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.192345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.192682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.192957] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.193177] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.193295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.193518] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.193668] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.194264] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.194264] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.194264] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.194264] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.194478] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.194478] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.194553] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.213742] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.213951] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.214148] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.214365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.214722] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-191f515f-0899-4557-b804-5777c7a4a23c taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.214932] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.215116] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.215460] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.215627] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191f515f-0899-4557-b804-5777c7a4a23c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.354713] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.354874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.355097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.355277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.355385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.355658] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.355766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.355831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.356014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.356089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.356179] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b already deleted. [ 1130.356259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.718874] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.718874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.718874] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.719116] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.719116] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.719455] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 191f515f-0899-4557-b804-5777c7a4a23c not found, creating... [ 1130.719866] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.720053] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.720276] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.720547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.721291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.721291] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.721442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.721499] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.721715] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.721842] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.721981] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 191f515f-0899-4557-b804-5777c7a4a23c is going to be created. [ 1130.744123] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.744123] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.744393] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.744769] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.745217] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.745562] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.465542] env[65222]: INFO networking_nsxv3.common.synchronization [req-ae4ba783-5a8f-4b8c-ab91-4c07548a92c0 req-7979e793-4e61-433a-9d99-c1ca8a9361f5 service nova] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1131.465809] env[65222]: INFO networking_nsxv3.common.synchronization [req-ae4ba783-5a8f-4b8c-ab91-4c07548a92c0 req-7979e793-4e61-433a-9d99-c1ca8a9361f5 service nova] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1131.466244] env[65222]: INFO networking_nsxv3.common.synchronization [req-ae4ba783-5a8f-4b8c-ab91-4c07548a92c0 req-7979e793-4e61-433a-9d99-c1ca8a9361f5 service nova] Enqueued Resource ID: 191f515f-0899-4557-b804-5777c7a4a23c with Priority: HIGHEST for action port [ 1131.466438] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1131.466571] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1131.466667] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 191f515f-0899-4557-b804-5777c7a4a23c with Priority: HIGHEST for action port [ 1131.469283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.469283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.469283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.469283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.469283] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.469443] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.469499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.469566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.469761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.469899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.469990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.470061] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.470199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.470278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.470365] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.471825] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-191f515f-0899-4557-b804-5777c7a4a23c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.471937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.471991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.472154] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.472225] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191f515f-0899-4557-b804-5777c7a4a23c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.624685] env[65222]: INFO networking_nsxv3.common.synchronization [None req-cedd009d-7a2a-42d6-a9d9-7e37343e4b07 tempest-AttachInterfacesTestJSON-1329071996 tempest-AttachInterfacesTestJSON-1329071996-project-member] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1131.625355] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGHEST for action security_group_members [ 1131.625716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.625835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.625911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.626558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.626794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.626907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.627014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.627236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.627371] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.627491] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.712832] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1131.713047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.713278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.713520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.713700] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.713810] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.713867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.714025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.714109] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.714225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.714330] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.976530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.976709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.977223] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.978279] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 191f515f-0899-4557-b804-5777c7a4a23c with status ACTIVE [ 1131.978279] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.978500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.978500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.979694] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.980024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.981969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.982541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.982634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.983395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.983395] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.983395] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 191f515f-0899-4557-b804-5777c7a4a23c is going to be updated. [ 1132.011136] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.011406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.011406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.011603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.011739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.011905] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.134664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.134958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.135117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.135617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.135617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.135960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.136188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.136280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.136548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.136692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.136846] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be updated. [ 1132.171366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.171366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.171547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.171686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.172115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.182720] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: IN_PROGRESS for 2s [ 1132.216953] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.217162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.217211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.217452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.217625] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.217811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.217872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.218137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.218230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.218350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.218507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.218581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.218639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.218789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.218978] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.219158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.219246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.219403] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.219483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.219569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.219658] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.484904] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.721597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccc4281e-6879-475e-a747-7907ebd40b7f: rpc.has_security_group_logging(os_id): False [ 1132.745581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.745788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.745788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.746043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.746135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.746344] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.746439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.746528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.746745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.746833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.747076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.747253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.747253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.747394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.747487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.747683] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.747768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.747836] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.747994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.748095] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.748183] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be created. [ 1132.814056] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.814284] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.814376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.814571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.814868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.828475] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: IN_PROGRESS for 2s [ 1132.991181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.991181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.991181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.991441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.991441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.991582] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be created. [ 1133.016865] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.017062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.017102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.017662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.017662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.030090] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: UNINITIALIZED for 2s [ 1134.193647] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 in Status: SUCCESS [ 1134.193647] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 deletion is rescheduled due to dependency. [ 1134.193647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.841904] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1134.842071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.042222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: SUCCESS [ 1135.042437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.042608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.045540] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.045540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.045540] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.545730] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.049557] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e866eb-f557-4c7e-9b34-d03a12e7238b: rpc.has_security_group_logging(os_id): False [ 1136.067780] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.068709] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.068709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.068986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.068986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.068986] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be created. [ 1136.142470] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.142470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.142470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.142470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.142470] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.154662] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: IN_PROGRESS for 2s [ 1136.355059] env[65222]: INFO networking_nsxv3.common.synchronization [None req-ba64d701-23c6-41b0-a405-0f40f4f99378 None None] Enqueued Resource ID: 21ede366-114e-4a29-9400-633fd9bd79ca with Priority: HIGHEST for action port [ 1136.355603] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ede366-114e-4a29-9400-633fd9bd79ca with Priority: HIGHEST for action port [ 1136.355908] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ede366-114e-4a29-9400-633fd9bd79ca taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.356695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ede366-114e-4a29-9400-633fd9bd79ca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.356789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ede366-114e-4a29-9400-633fd9bd79ca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.357044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ede366-114e-4a29-9400-633fd9bd79ca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.357135] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ede366-114e-4a29-9400-633fd9bd79ca',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.859730] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21ede366-114e-4a29-9400-633fd9bd79ca [ 1136.860076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.860076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.860178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.860372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.860478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.860597] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21ede366-114e-4a29-9400-633fd9bd79ca already deleted. [ 1136.860693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ede366-114e-4a29-9400-633fd9bd79ca" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.170694] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: SUCCESS [ 1138.171093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.345080] env[65222]: INFO networking_nsxv3.common.synchronization [None req-aa6efe54-4c3a-4da4-abff-8b856d93c29e None None] Enqueued Resource ID: 2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab with Priority: HIGHEST for action port [ 1138.345650] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab with Priority: HIGHEST for action port [ 1138.345972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.346125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.346191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.346548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.346642] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.849214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab [ 1138.849598] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.849736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.849787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.850053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.850171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.850319] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab already deleted. [ 1138.850410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f96bc9c-9f6d-41c5-a39d-cf4941d6e8ab" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.477370] env[65222]: INFO networking_nsxv3.common.synchronization [req-99675c84-6fc1-4034-b755-e4bd1e04e928 req-4e0e5671-2365-4533-a707-2431464dbe11 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1140.477891] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1140.478233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.478960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.478960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.478960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.478960] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.479630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.479630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.479630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.479758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.479831] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.819063] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.819063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.819063] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.820140] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.820504] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.820735] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.820901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.821241] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.821459] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.821714] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.821882] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.822054] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.822202] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.822362] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.822474] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.822624] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.844966] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.845202] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.845344] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.845587] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.845883] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-83413b3e-70f6-48d8-9390-9ad868c931f3 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.846066] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.846233] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.846556] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.846691] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83413b3e-70f6-48d8-9390-9ad868c931f3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.982072] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.349266] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.349583] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.349673] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.350127] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.350312] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.350519] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 83413b3e-70f6-48d8-9390-9ad868c931f3 not found, creating... [ 1141.350817] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.351156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.351317] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.351711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.351875] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.352191] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.352352] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.352478] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.352699] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.352837] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.352972] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 83413b3e-70f6-48d8-9390-9ad868c931f3 is going to be created. [ 1141.377866] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.378103] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.378213] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.378511] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.378739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.378973] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.484795] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.987168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.987339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.987412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.987631] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.987720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.987825] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1142.019297] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.019492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.019492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.019710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.019851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.029862] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1142.070349] env[65222]: INFO networking_nsxv3.common.synchronization [req-99675c84-6fc1-4034-b755-e4bd1e04e928 req-b180ec20-2878-47b4-af9a-de3eef625ed7 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1142.070612] env[65222]: INFO networking_nsxv3.common.synchronization [req-99675c84-6fc1-4034-b755-e4bd1e04e928 req-b180ec20-2878-47b4-af9a-de3eef625ed7 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1142.070706] env[65222]: INFO networking_nsxv3.common.synchronization [req-99675c84-6fc1-4034-b755-e4bd1e04e928 req-b180ec20-2878-47b4-af9a-de3eef625ed7 service nova] Enqueued Resource ID: 83413b3e-70f6-48d8-9390-9ad868c931f3 with Priority: HIGHEST for action port [ 1142.071198] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1142.071331] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1142.071424] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83413b3e-70f6-48d8-9390-9ad868c931f3 with Priority: HIGHEST for action port [ 1142.071697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.071811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.071876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.072101] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.072184] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.073053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.073165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.073400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-83413b3e-70f6-48d8-9390-9ad868c931f3 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.073523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.073561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.073731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.073803] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83413b3e-70f6-48d8-9390-9ad868c931f3',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.575386] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.575386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.575805] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83413b3e-70f6-48d8-9390-9ad868c931f3 with status ACTIVE [ 1142.575805] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.575885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.575975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.576176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.576285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.576467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.576561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.576623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.576782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.576856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.577049] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.577142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.577203] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.577339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.577424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.577490] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83413b3e-70f6-48d8-9390-9ad868c931f3 is going to be updated. [ 1142.598718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.598864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.598932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.601188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.601188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.601188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83413b3e-70f6-48d8-9390-9ad868c931f3" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.041194] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1144.041552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.041650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.041843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.042042] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.042162] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.042226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.042377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.042458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.042547] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.545220] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.047427] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.549761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.549993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.550064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.550282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.550406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.550509] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1145.581726] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.581926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.581926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.582193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.582402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.592397] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1146.474057] env[65222]: INFO networking_nsxv3.common.synchronization [req-9036e5b2-2bbd-4375-bb90-76c7857cf29d req-ce60dfa3-fd24-407a-b3bc-9d0df0009c48 tempest-DeleteServersTestJSON-823474022 tempest-DeleteServersTestJSON-823474022-project-member] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1146.474419] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGHEST for action security_group_members [ 1146.474735] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.474858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.474959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.475410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.475554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.475717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.475811] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.476017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.476128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.476290] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.979694] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.979694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.979977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.979977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.980097] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.980199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.980261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.980473] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.980566] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.980648] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be updated. [ 1147.012270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.012485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.012485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.012739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.012884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.022726] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: IN_PROGRESS for 2s [ 1147.605028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1147.605324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.605448] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.605724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.605815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.606083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.606083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.606159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.606352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.606352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.606408] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.892860] env[65222]: INFO networking_nsxv3.common.synchronization [req-83f7df2f-fe04-4cbc-8c1e-a0ded82d6821 req-ed64028f-95c2-4df0-a1c6-b4759ff7cb10 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1147.893990] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1147.894412] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.894737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.894868] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.895301] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.895438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.895606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.895854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.896098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.896234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.896445] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.108578] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.108781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.108828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.109026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.109193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.109293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.109358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.109528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.109616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.109703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.109861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.109954] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.110025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.110169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.110306] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.110412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.110455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.110584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.110655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.110735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.110824] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.210497] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.210497] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-493" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.210698] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-493" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.210968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-493" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.211239] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.211396] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.211511] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.211724] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.211867] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.212100] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.212211] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.212319] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.212449] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.212564] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.212671] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.212801] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.231700] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.231933] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.232040] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.232231] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-493" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.232562] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.232754] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.232876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.233243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.233451] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.399276] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.399276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.399519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.399519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.399647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.399823] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.399923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.399987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.400149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.400260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.400339] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a already deleted. [ 1148.400410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.612774] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1148.633902] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.634127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.634218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.634354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.634471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.634628] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.634781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.634781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.634929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.635067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.635199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.635351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.635351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.635549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.635549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.635845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.635998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.635998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.636163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.636287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.636346] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1148.700895] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.701145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.701279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.701531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.701769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.714357] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1148.738711] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.738711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 not found, creating... [ 1148.738711] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.738711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.739378] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.739378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.739378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.739378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.739378] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.739378] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 is going to be created. [ 1148.765094] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.765331] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.765394] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.765805] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.766102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.766404] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.032903] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 034ec8fb-de90-4302-acab-f4bec595dd2d in Status: SUCCESS [ 1149.033010] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d deletion is rescheduled due to dependency. [ 1149.033138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.478234] env[65222]: INFO networking_nsxv3.common.synchronization [req-83f7df2f-fe04-4cbc-8c1e-a0ded82d6821 req-76dcd1d7-6712-4a28-b755-a45137fba4d5 service nova] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1149.478665] env[65222]: INFO networking_nsxv3.common.synchronization [req-83f7df2f-fe04-4cbc-8c1e-a0ded82d6821 req-76dcd1d7-6712-4a28-b755-a45137fba4d5 service nova] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1149.479189] env[65222]: INFO networking_nsxv3.common.synchronization [req-83f7df2f-fe04-4cbc-8c1e-a0ded82d6821 req-76dcd1d7-6712-4a28-b755-a45137fba4d5 service nova] Enqueued Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1149.480134] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1149.480270] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1149.480368] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1149.480640] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.480761] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.480829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.481770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.481878] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.482787] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.482924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.482993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.483240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.483434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.483535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.483596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.483741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.483826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.483916] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.484737] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.484866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.484912] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.485741] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.485823] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.988258] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.988637] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.988637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.988850] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with status ACTIVE [ 1149.988882] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.989039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.989092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.989270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.989360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.989756] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.989756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.989756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.989996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.989996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.990104] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.990174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.990325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.991189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.991189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.991189] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 is going to be updated. [ 1150.013609] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.013609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.013609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.013609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.013945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.013945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.493364] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.726677] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1150.726956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.995548] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.995866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.995866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.995982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.996239] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.996239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be created. [ 1151.025289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.025440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.025511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.025754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.025941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.037679] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: UNINITIALIZED for 2s [ 1152.550667] env[65222]: INFO networking_nsxv3.common.synchronization [req-e9cb8d23-3bcd-498a-8db8-d91401681c3e req-ee6c5864-cab1-4c99-b826-e39d540ba84f tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1152.551143] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1152.551507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.551633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.551753] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.552116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.552275] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.552374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.552374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.552567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.552649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.552744] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.049805] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1153.050031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.050204] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.050504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.050821] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.050971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.051196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.051196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.051360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.051390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.051517] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.055098] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.055485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.055485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.055485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.055642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.055873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.055873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.056037] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.056067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.056161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.056292] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be updated. [ 1153.081926] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.082157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.082157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.082305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.082453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.092356] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: IN_PROGRESS for 2s [ 1153.396986] env[65222]: INFO networking_nsxv3.common.synchronization [req-da336e30-f8a2-4e4e-96e3-8b408b95f29b req-5eacfa0f-dcf5-4fb9-8854-c8443b549475 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1153.397585] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1153.397901] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.398100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.398178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.398388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.398549] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.398650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.398710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.398859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.398944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.399051] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.556740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.556740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.556740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.556740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.556740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.557907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.557907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.557907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.557907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.557907] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.903140] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.060460] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf43cf95-d5e3-4ee6-aede-a91dff066d6a: rpc.has_security_group_logging(os_id): False [ 1154.079740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.080024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.080024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.080175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.080264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.080542] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.080678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.080732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.080857] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.080927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.081125] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.081231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.081286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.081498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.081563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.081760] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.081880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.081955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.082050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.082106] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.082200] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be created. [ 1154.143288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.143633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.143695] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.143910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.144113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.155509] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1154.406379] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.911613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.911613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.911613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.911613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.912240] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.912240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1154.948108] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.948306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.948306] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.948434] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.948543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.961856] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1155.105897] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1155.105897] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f deletion is rescheduled due to dependency. [ 1155.105897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.169531] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1156.169850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.540851] env[65222]: INFO networking_nsxv3.common.synchronization [req-c0d22e66-8817-41f2-a53b-ec10a5020d90 req-4b0303c2-3743-4b23-a3bd-3ea74a37b749 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1156.541466] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGHEST for action security_group_members [ 1156.541777] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.541921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.541970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.542827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.544649] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.544649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.544760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.544840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.544927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.545036] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.749973] env[65222]: INFO networking_nsxv3.common.synchronization [None req-0eeb2c82-7588-4627-8c9d-bdf3f22aadf0 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1156.754684] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1156.755068] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.755198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.756027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.756027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.756027] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.854148] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e8dd1381-32b6-4347-85c3-2c77e7deb2c7 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1156.854148] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1156.854148] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.854148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.972379] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1156.972635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.048467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.049015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.049121] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.049406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.076965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.077262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.077382] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.077491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.077819] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.077898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.077996] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 is going to be updated. [ 1157.103718] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.103877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.104478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.104771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.105710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.116145] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: IN_PROGRESS for 2s [ 1157.292524] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.292835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.292835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.292955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.293056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.293160] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d already deleted. [ 1157.293246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.293841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.294028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.294119] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.818235] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.818235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.818235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.818481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.818481] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.818554] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d already deleted. [ 1157.818699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.578240] env[65222]: INFO networking_nsxv3.common.synchronization [None req-874bb88b-d662-49f6-96b4-8698cfa6bdab None None] Enqueued Resource ID: 67b5dfcd-e21b-4761-ae67-17659e2caf9f with Priority: HIGHEST for action port [ 1158.579116] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b5dfcd-e21b-4761-ae67-17659e2caf9f with Priority: HIGHEST for action port [ 1158.579480] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b5dfcd-e21b-4761-ae67-17659e2caf9f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.579644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b5dfcd-e21b-4761-ae67-17659e2caf9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.579739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b5dfcd-e21b-4761-ae67-17659e2caf9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.580054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b5dfcd-e21b-4761-ae67-17659e2caf9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.580166] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b5dfcd-e21b-4761-ae67-17659e2caf9f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.082379] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67b5dfcd-e21b-4761-ae67-17659e2caf9f [ 1159.082593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.082721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.082790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.083012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.083102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.083201] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67b5dfcd-e21b-4761-ae67-17659e2caf9f already deleted. [ 1159.083293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b5dfcd-e21b-4761-ae67-17659e2caf9f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.127732] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 in Status: SUCCESS [ 1159.127732] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 deletion is rescheduled due to dependency. [ 1159.127732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.727245] env[65222]: INFO networking_nsxv3.common.synchronization [None req-96ba8f99-f08d-4574-9e16-eb49e994a932 None None] Enqueued Resource ID: bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa with Priority: HIGHEST for action port [ 1160.727529] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa with Priority: HIGHEST for action port [ 1160.728240] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.728390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.728456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.728716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.728805] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.233031] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa [ 1161.233031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.233031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.233272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.233313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.233446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.233600] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa already deleted. [ 1161.233713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcfb6619-92c8-4ee4-b5f4-287c2b5e29aa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.728375] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1165.728748] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1165.901181] env[65222]: INFO networking_nsxv3.common.synchronization [req-0d06ed00-c96d-4bba-8673-950210e6b153 req-0e0208b4-e43f-4ff7-a386-659dac48c4ee tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1165.901666] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1165.901966] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.902105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.902225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.902475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.902636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.902742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.902802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.902956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.903051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.903149] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.216353] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.216508] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.216621] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.217259] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.218030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.218030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.218030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.218030] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.218295] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.218348] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.218471] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.218582] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.218708] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.218941] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.218941] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.219062] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.242551] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.242705] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1166.242849] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.243082] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.243408] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-aefb4cbf-9593-4976-8b3c-0050b704aad1 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.243674] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.243798] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.244261] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.244397] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aefb4cbf-9593-4976-8b3c-0050b704aad1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.405704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.405987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.405987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.406192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.406281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.406472] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.406611] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.406658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.406776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.406858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.406937] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d already deleted. [ 1166.407027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.747417] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.747805] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.747805] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.748058] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.748210] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.748367] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port aefb4cbf-9593-4976-8b3c-0050b704aad1 not found, creating... [ 1166.748716] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.748895] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.749026] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.749288] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.749439] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.749820] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.750129] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.750314] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.750536] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.750711] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.750866] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: aefb4cbf-9593-4976-8b3c-0050b704aad1 is going to be created. [ 1166.772045] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.772313] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.772431] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.772721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.772959] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.773209] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.344946] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.345140] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.345655] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.345832] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.346975] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef633142-20c2-40c4-bf3f-5844d71fcc80 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.347255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.347324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.347599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.347814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.348013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.348144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.348419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.348553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.348675] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.350977] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.350977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.350977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.350977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.351265] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.351265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.351265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.351543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.353357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.353357] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.394774] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1167.394927] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.395066] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_rules [ 1167.395259] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.395316] env[65222]: INFO networking_nsxv3.common.synchronization [req-7a1b281a-3a19-484a-92fc-0a36606d46f6 req-04004b86-2939-4181-9cfa-bd869c969502 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1167.395908] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1167.396435] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_rules [ 1167.396869] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1167.396869] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.396869] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.398379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.398525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.398756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.398917] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.398967] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.401508] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef633142-20c2-40c4-bf3f-5844d71fcc80 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.401630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.401780] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.402652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.402652] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.404229] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.404229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.404229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.404229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.404229] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.405455] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.405455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.405455] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef633142-20c2-40c4-bf3f-5844d71fcc80 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.405455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.480783] env[65222]: INFO networking_nsxv3.common.synchronization [req-0d06ed00-c96d-4bba-8673-950210e6b153 req-1b506a23-c781-4c26-9b2e-249178caa953 service nova] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1167.480783] env[65222]: INFO networking_nsxv3.common.synchronization [req-0d06ed00-c96d-4bba-8673-950210e6b153 req-1b506a23-c781-4c26-9b2e-249178caa953 service nova] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1167.480783] env[65222]: INFO networking_nsxv3.common.synchronization [req-0d06ed00-c96d-4bba-8673-950210e6b153 req-1b506a23-c781-4c26-9b2e-249178caa953 service nova] Enqueued Resource ID: aefb4cbf-9593-4976-8b3c-0050b704aad1 with Priority: HIGHEST for action port [ 1167.481245] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_rules [ 1167.481383] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1167.481537] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aefb4cbf-9593-4976-8b3c-0050b704aad1 with Priority: HIGHEST for action port [ 1167.482026] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.482143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.482205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.482411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.482501] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.483324] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.483430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.483546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.483716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.483855] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.483945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.484009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.484178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.484262] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.484337] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.485187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-aefb4cbf-9593-4976-8b3c-0050b704aad1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.485187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.485397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.485397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.485478] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aefb4cbf-9593-4976-8b3c-0050b704aad1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.709761] env[65222]: INFO networking_nsxv3.common.synchronization [req-fd5c67b9-30bf-415e-856a-748f5de96695 req-47147612-285c-49b3-a94d-ff9b063f7045 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.709980] env[65222]: INFO networking_nsxv3.common.synchronization [req-fd5c67b9-30bf-415e-856a-748f5de96695 req-47147612-285c-49b3-a94d-ff9b063f7045 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.710571] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 with Priority: HIGHEST for action security_group_members [ 1167.710571] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.710839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef633142-20c2-40c4-bf3f-5844d71fcc80 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.710946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.711488] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.711602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.765136] env[65222]: INFO networking_nsxv3.common.synchronization [req-fd5c67b9-30bf-415e-856a-748f5de96695 req-47147612-285c-49b3-a94d-ff9b063f7045 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1167.765484] env[65222]: INFO networking_nsxv3.common.synchronization [req-fd5c67b9-30bf-415e-856a-748f5de96695 req-47147612-285c-49b3-a94d-ff9b063f7045 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.765565] env[65222]: INFO networking_nsxv3.common.synchronization [req-fd5c67b9-30bf-415e-856a-748f5de96695 req-47147612-285c-49b3-a94d-ff9b063f7045 tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1167.766372] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_rules [ 1167.766512] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1167.766623] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with Priority: HIGHEST for action port [ 1167.766963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.767089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.767367] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.767428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.767616] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.767699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.851304] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.854348] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.906719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.906719] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.906967] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef633142-20c2-40c4-bf3f-5844d71fcc80 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.907105] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.907158] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with status ACTIVE [ 1167.907291] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.907400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.907480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.907654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.907773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.907914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.908052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.908052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.908212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.908280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.908466] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.908588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.908660] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.908749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.908821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.908886] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 is going to be updated. [ 1167.933412] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.933740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.933740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.933888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.934042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.934206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.934359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.934514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.934583] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.987187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.987401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.987511] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.988515] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aefb4cbf-9593-4976-8b3c-0050b704aad1 with status ACTIVE [ 1167.988634] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.988728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.988873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.991266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.991266] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.991266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.991266] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aefb4cbf-9593-4976-8b3c-0050b704aad1 is going to be updated. [ 1168.014672] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.014672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.014672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.014672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.014672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.015138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aefb4cbf-9593-4976-8b3c-0050b704aad1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.112728] env[65222]: INFO networking_nsxv3.common.synchronization [req-736f6a41-47ef-498b-af23-ed9568531a05 req-e7a524b3-5e5e-42de-8c36-ec4d960c1737 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1168.113297] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1168.113633] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.113756] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.113825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.114233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.114233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.114357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.114357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.114487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.114583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.114696] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.355251] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.356920] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.436903] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 with status ACTIVE [ 1168.437155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.437300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.437373] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.437597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.437712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.437951] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.438081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.438145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.438309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.438388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.438581] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.438723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.439461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.439461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.439461] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.439461] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957 is going to be updated. [ 1168.463337] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.463595] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.463739] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.464106] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.464388] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.464650] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.464828] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.465080] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.465360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.465501] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.465639] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.465772] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.465983] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.466146] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.466397] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.466456] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.469086] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.469238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.469327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.469569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.470193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.470193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e6aeb58-ffcf-40d9-9cb2-f1f10ef46957" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.492366] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.503423] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.504416] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.504690] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.504981] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-59" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.505372] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-479ebcc3-060e-4422-a052-00b0ac19e848 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.505609] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.505841] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.506335] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.506489] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('479ebcc3-060e-4422-a052-00b0ac19e848',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.617816] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.858970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.859315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.859365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.859623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.859967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.859967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 is going to be created. [ 1168.861180] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.861357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.861466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.861671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.861798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.861927] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1168.885337] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.885599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.885723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.886009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.886242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.889992] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.890213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.890325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.890565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.890775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.899402] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1168.900266] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 in Status: UNINITIALIZED for 2s [ 1168.995880] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.995880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.995880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.995880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.997627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.997627] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d is going to be created. [ 1169.008988] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.009641] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.010446] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.010446] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.010446] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.010809] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 479ebcc3-060e-4422-a052-00b0ac19e848 not found, creating... [ 1169.011194] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.011501] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.011691] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.011977] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.012194] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.012567] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.012858] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.013051] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.013525] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.013603] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.013803] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 479ebcc3-060e-4422-a052-00b0ac19e848 is going to be created. [ 1169.020415] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.020627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.020763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.020997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.021617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.034590] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: UNINITIALIZED for 2s [ 1169.037422] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.037835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.038062] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.038414] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.038705] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.039020] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.120814] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.623379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.623742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.623742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.624170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.624170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.624170] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1169.658343] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.658343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.658574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.658645] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.658794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.669625] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1169.728818] env[65222]: INFO networking_nsxv3.common.synchronization [req-736f6a41-47ef-498b-af23-ed9568531a05 req-cefe913b-bc47-4afd-b9da-9673c4491806 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1169.728968] env[65222]: INFO networking_nsxv3.common.synchronization [req-736f6a41-47ef-498b-af23-ed9568531a05 req-cefe913b-bc47-4afd-b9da-9673c4491806 service nova] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1169.729252] env[65222]: INFO networking_nsxv3.common.synchronization [req-736f6a41-47ef-498b-af23-ed9568531a05 req-cefe913b-bc47-4afd-b9da-9673c4491806 service nova] Enqueued Resource ID: 479ebcc3-060e-4422-a052-00b0ac19e848 with Priority: HIGHEST for action port [ 1169.729402] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_rules [ 1169.729528] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1169.729625] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479ebcc3-060e-4422-a052-00b0ac19e848 with Priority: HIGHEST for action port [ 1169.730588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.730711] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.730779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.730970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.731117] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.731895] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.731994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.732198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-479ebcc3-060e-4422-a052-00b0ac19e848 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.732661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.732661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.732661] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.732661] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('479ebcc3-060e-4422-a052-00b0ac19e848',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.234221] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.234640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.234640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 479ebcc3-060e-4422-a052-00b0ac19e848 with status ACTIVE [ 1170.234815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.234950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.235064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.235282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.235389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.235590] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.235708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.235779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.236062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.236178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.236378] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.236503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.236584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.236733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.236830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.236945] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 479ebcc3-060e-4422-a052-00b0ac19e848 is going to be updated. [ 1170.262848] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.263053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.263053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.263277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.263413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.263679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-479ebcc3-060e-4422-a052-00b0ac19e848" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.427705] env[65222]: INFO networking_nsxv3.common.synchronization [req-748eae53-11b9-4f6d-bda0-1659210aab0c req-004f8b9b-f729-4951-8f2b-52dea0cf54c3 tempest-ServerMetadataTestJSON-908165715 tempest-ServerMetadataTestJSON-908165715-project-member] Enqueued Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1170.428612] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1170.428612] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.428715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.428755] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.429013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.429170] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.429272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.429336] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.429634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.429634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.429731] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.868054] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.868282] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-416" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.868405] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-416" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.868740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-416" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.868996] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.869164] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.869278] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.869483] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.869625] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.869828] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.870044] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.870044] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.870150] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.870256] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.870368] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.870483] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.888684] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.888840] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.888977] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.889164] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-416" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.889472] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-69c46248-d5b9-4f9c-9455-bb5382005971 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.889637] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.889762] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.890109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.890248] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69c46248-d5b9-4f9c-9455-bb5382005971',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.911550] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1170.911772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.911926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.912176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.912366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.912482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.912558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.912724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.912808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.912903] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.915469] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 in Status: SUCCESS [ 1170.915693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.916887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.916887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.916887] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.916887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.916887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.916887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.917161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.917161] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.933208] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.933208] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.933208] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 already deleted. [ 1170.933208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.043905] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: SUCCESS [ 1171.044148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.044569] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.044830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.045038] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.045163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.045230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.045384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.045557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.045747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.045850] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.392638] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.392986] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.392986] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.393282] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.393431] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.393668] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 69c46248-d5b9-4f9c-9455-bb5382005971 not found, creating... [ 1171.393938] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.394104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.394218] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.394444] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.394585] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.394861] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.395029] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.395164] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.395344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.395473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.395607] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 69c46248-d5b9-4f9c-9455-bb5382005971 is going to be created. [ 1171.420509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.420773] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.420946] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.421274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.421635] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.421979] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.423743] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.424247] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.424428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.424543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.425081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.425081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.425243] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.425410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.425527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.425775] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.425934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.426092] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 is going to be deleted. [ 1171.464908] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.465166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.465166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.465346] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.465441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.465543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.466553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.466731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.466911] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.467027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.467096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.467245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.467326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.467419] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.550416] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.682187] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1171.682517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.682784] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.683076] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.683325] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.683477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.683630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.683843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.683943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.684100] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.928404] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.971049] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.971049] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.971049] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 already deleted. [ 1171.971049] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.971706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.971706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.971782] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.971865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.971927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.972086] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.972158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.972639] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.052879] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d: rpc.has_security_group_logging(os_id): False [ 1172.070643] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.070827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.070911] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.071218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.071337] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.071800] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.071936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.072054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.072310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.072379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.072783] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d is going to be created. [ 1172.142194] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.143066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.143066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.143066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.143236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.158057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: IN_PROGRESS for 2s [ 1172.162729] env[65222]: INFO networking_nsxv3.common.synchronization [req-748eae53-11b9-4f6d-bda0-1659210aab0c req-93a9cd1c-8f7d-424d-a13a-17e5fdbf52e8 service nova] Enqueued Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_rules [ 1172.162910] env[65222]: INFO networking_nsxv3.common.synchronization [req-748eae53-11b9-4f6d-bda0-1659210aab0c req-93a9cd1c-8f7d-424d-a13a-17e5fdbf52e8 service nova] Enqueued Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1172.163090] env[65222]: INFO networking_nsxv3.common.synchronization [req-748eae53-11b9-4f6d-bda0-1659210aab0c req-93a9cd1c-8f7d-424d-a13a-17e5fdbf52e8 service nova] Enqueued Resource ID: 69c46248-d5b9-4f9c-9455-bb5382005971 with Priority: HIGHEST for action port [ 1172.163288] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_rules [ 1172.163416] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1172.163559] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c46248-d5b9-4f9c-9455-bb5382005971 with Priority: HIGHEST for action port [ 1172.165032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.165032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.165032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.165300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.165400] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.168949] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.169118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.169236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.169438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.169608] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.169750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.169822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.170010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.170126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.170236] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.171189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-69c46248-d5b9-4f9c-9455-bb5382005971 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.171308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.171452] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.171632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.171726] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69c46248-d5b9-4f9c-9455-bb5382005971',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.187975] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.431470] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.431867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.431867] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.431966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.432026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.432175] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1172.467723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.467920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.467976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.468181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.468332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.478387] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.478651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.478651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.478967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.479169] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.479487] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.479666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.479837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.480103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.480195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.480337] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 already deleted. [ 1172.480402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.480477] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.482777] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1172.669642] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.669890] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.673393] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.674577] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69c46248-d5b9-4f9c-9455-bb5382005971 with status ACTIVE [ 1172.674793] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.674946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.675066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.675348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.675411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.675657] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.675729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.675794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.675999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.676090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.676281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.676368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.676861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.676861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.676861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.676861] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69c46248-d5b9-4f9c-9455-bb5382005971 is going to be updated. [ 1172.690066] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.698254] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.698412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.698467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.698656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.698791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.698956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69c46248-d5b9-4f9c-9455-bb5382005971" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.984844] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef633142-20c2-40c4-bf3f-5844d71fcc80',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.179349] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.192081] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.192344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.192344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.192553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.192676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.192799] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1173.226913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.227119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.227119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.227332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.227501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.237118] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1173.487572] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef633142-20c2-40c4-bf3f-5844d71fcc80: rpc.has_security_group_logging(os_id): False [ 1173.506907] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.506907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.506907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.506907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.506907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.506907] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.507233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.507233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.507288] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.507326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.507407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 is going to be created. [ 1173.522153] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80], does not exist path=[/infra/domains/default/groups/ef633142-20c2-40c4-bf3f-5844d71fcc80]."\n}' [ 1173.522313] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80 [ 1173.522369] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1173.558720] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.558902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.558995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.559229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.560314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.560648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.560776] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.560838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.561114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.561219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.561423] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.561548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.561612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.561809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.561891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.561979] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef633142-20c2-40c4-bf3f-5844d71fcc80 is going to be created. [ 1173.576990] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80], does not exist path=[/infra/domains/default/groups/ef633142-20c2-40c4-bf3f-5844d71fcc80]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80 [ 1173.577182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef633142-20c2-40c4-bf3f-5844d71fcc80" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.577433] env[65222]: Traceback (most recent call last): [ 1173.577485] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1173.577485] env[65222]: return func(*args, **kwargs) [ 1173.577485] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1173.577485] env[65222]: res.raise_for_status() [ 1173.577485] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1173.577485] env[65222]: raise HTTPError(http_error_msg, response=self) [ 1173.577485] env[65222]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80 [ 1173.577485] env[65222]: During handling of the above exception, another exception occurred: [ 1173.577485] env[65222]: Traceback (most recent call last): [ 1173.577485] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1173.577485] env[65222]: listener.cb(fileno) [ 1173.577485] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1173.577485] env[65222]: result = function(*args, **kwargs) [ 1173.577485] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1173.577485] env[65222]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1173.577485] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1173.577485] env[65222]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1173.577485] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1173.577485] env[65222]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1173.578134] env[65222]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1173.578134] env[65222]: res.raise_for_status() [ 1173.578134] env[65222]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1173.578134] env[65222]: raise HTTPError(http_error_msg, response=self) [ 1173.578134] env[65222]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ef633142-20c2-40c4-bf3f-5844d71fcc80 [ 1173.578134] env[65222]: Removing descriptor: 24 [ 1173.681473] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.681686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.681778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.681996] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.682182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.682428] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 is going to be created. [ 1173.708833] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.708994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.709052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.709268] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.709418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.721963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: UNINITIALIZED for 2s [ 1174.088534] env[65222]: INFO networking_nsxv3.common.synchronization [req-eaf5ae95-e01c-4d9b-85a7-58e9ac970bac req-711702d3-97d3-4d9e-8d8c-a89013b0b49a tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1174.089121] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1174.089426] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.089547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.089609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.089808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.089958] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.090317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.090399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.090571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.090644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.090756] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.171283] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: SUCCESS [ 1174.171585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.497138] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1174.497507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.497507] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.497721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.497903] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.498029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.498094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.498248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.498329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.498421] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.597033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.597230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.597230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.597438] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.620149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.620404] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.620528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.620580] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.621131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.621250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.621391] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1174.648073] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.648324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.648424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.648738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.648964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.658659] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1174.935257] env[65222]: INFO networking_nsxv3.common.synchronization [req-e797a658-bd75-4fb7-bc89-ce71aafdd801 req-1a7c3690-af17-41af-9d2c-952d69ebeb1b tempest-ServerRescueTestJSONUnderV235-768562135 tempest-ServerRescueTestJSONUnderV235-768562135-project-member] Enqueued Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1174.935901] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a with Priority: HIGHEST for action security_group_members [ 1174.936236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.936343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.001545] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.249522] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1175.249522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.249658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.251082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.251082] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.251082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.251082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.251082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.251082] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.251478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.251478] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.503593] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.734050] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: SUCCESS [ 1175.734276] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.734442] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.734699] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.734907] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.735043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.735108] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.735266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.735345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.735430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.735531] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.753373] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.753572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.753626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.753835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.754035] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.754166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.754228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.754385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.754468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.754571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.754786] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.754897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.754959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.755118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.755260] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.755366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.755413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.755542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.755617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.755694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.755780] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.005719] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.005901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.005901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.006207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.006339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.006453] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1176.040295] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.040598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.040598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.040851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.041056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.051241] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1176.237813] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.237813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.237813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.238022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.240594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.240594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.240594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.240594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.240594] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.258192] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdeb067-1c84-46bf-b468-65ab19cb86dc: rpc.has_security_group_logging(os_id): False [ 1176.296622] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.296835] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.296898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.297184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.325015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.325379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.325549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.325597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.325924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.325924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.326214] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.326302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.326372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.326610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.326766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.327020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.327238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.327238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.327344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.327449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.327607] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1176.399175] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.399175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.399175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.399175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.399175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.412877] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1176.671476] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1176.672927] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 deletion is rescheduled due to dependency. [ 1176.673427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.744231] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504: rpc.has_security_group_logging(os_id): False [ 1176.768031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.768031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.768031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.768031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.769234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.771854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.771854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.771854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.771854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.771854] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 is going to be created. [ 1176.837664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.837664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.837664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.839104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.839104] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.851028] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: IN_PROGRESS for 2s [ 1178.066022] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.066022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.066022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.066022] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.429603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1178.429781] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.568607] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.568860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.568932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.569192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.595864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.596219] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.596377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.596547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.596725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.596822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.596906] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1178.630488] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.630892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.631019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.631258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.631449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.647373] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1178.862603] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: SUCCESS [ 1178.862829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.938017] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1179.939293] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1180.657171] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1180.657327] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a deletion is rescheduled due to dependency. [ 1180.657327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.657746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.657746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.657894] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.658067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.658067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.658234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.658443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.658443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.658529] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.660165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.660348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.661572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.661572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.661572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.661572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.661572] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.661572] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.160593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.160947] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.163369] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.163528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.163698] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.163932] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.164038] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.164236] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.164333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.164396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.164552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.164658] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.164789] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1181.199942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.200152] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.200197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.200399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.200549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.210239] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1182.866373] env[65222]: INFO networking_nsxv3.common.synchronization [req-28e450f0-765b-4653-97b1-26e51bcbe965 req-747ab301-7236-4591-9fb6-20382d6336ff tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1182.866560] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1182.866855] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.867389] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.867482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.867663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.868113] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.868113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.868113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.868282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.868282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.868396] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.166681] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.166872] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.166997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.167360] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.167687] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.167868] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.167988] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.168319] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.168491] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.168783] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.169293] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.169293] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.169293] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.169459] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.169459] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.169596] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.190711] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.190901] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.191009] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.191305] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.191779] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2f786f00-aa6a-4cd9-84aa-84d80f602efa taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.191990] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.192135] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.192496] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.192712] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f786f00-aa6a-4cd9-84aa-84d80f602efa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.227626] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 4s [ 1183.370844] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.371048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.371181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.371390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.371488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.371771] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.371879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.371968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.372160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.372253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.372372] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1183.404611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.404779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.404833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.406081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.406081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.416798] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1183.695677] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.696145] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.696145] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.698509] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 2f786f00-aa6a-4cd9-84aa-84d80f602efa not found, creating... [ 1183.698509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.698509] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.698509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.698932] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.698932] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.698932] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.698932] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa is going to be created. [ 1183.798353] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.798567] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.798694] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.798981] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.799220] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.799442] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.763369] env[65222]: INFO networking_nsxv3.common.synchronization [req-d0a86823-9595-4733-910b-f3a918a691a3 req-e58d5e4f-0bdf-4c2a-b2ed-ee75c5724c24 tempest-ServerMetadataTestJSON-908165715 tempest-ServerMetadataTestJSON-908165715-project-member] Enqueued Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1184.764155] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGHEST for action security_group_members [ 1184.764600] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.764808] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.764961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.765142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.765371] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.765504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.765557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.765714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.765844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.765977] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.874246] env[65222]: INFO networking_nsxv3.common.synchronization [req-28e450f0-765b-4653-97b1-26e51bcbe965 req-cf62e625-127e-4cf4-9dc5-7f1b102b1a60 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1184.874541] env[65222]: INFO networking_nsxv3.common.synchronization [req-28e450f0-765b-4653-97b1-26e51bcbe965 req-cf62e625-127e-4cf4-9dc5-7f1b102b1a60 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1184.875072] env[65222]: INFO networking_nsxv3.common.synchronization [req-28e450f0-765b-4653-97b1-26e51bcbe965 req-cf62e625-127e-4cf4-9dc5-7f1b102b1a60 service nova] Enqueued Resource ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa with Priority: HIGHEST for action port [ 1184.876263] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1184.876620] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1184.876929] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa with Priority: HIGHEST for action port [ 1184.877460] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.877871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.878132] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.878735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.878735] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.879829] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.879991] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.880323] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f786f00-aa6a-4cd9-84aa-84d80f602efa taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.880685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.880685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.880793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.881735] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f786f00-aa6a-4cd9-84aa-84d80f602efa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.130630] env[65222]: INFO networking_nsxv3.common.synchronization [req-6bfb257a-a2a4-4bb9-8a20-5c5ff779c134 req-4ade0bf3-ac21-48db-b576-5f15bd624e01 tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1185.131305] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1185.131802] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.131802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.132048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.132093] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.132239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.132342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.132406] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.132563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.132652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.132748] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.236999] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1185.237195] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a deletion is rescheduled due to dependency. [ 1185.237273] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.237425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.237643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.237843] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.238015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.238099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.238263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.238340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.238424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.238588] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.238686] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.238747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.238885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.239039] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.239135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.239195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.239329] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.239399] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.239476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.239561] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.268492] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.268683] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.268757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.269099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.269251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.269491] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.269643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.269693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.269948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.270046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.270145] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 is going to be updated. [ 1185.319151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.319151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.319151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.319151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.319465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.332983] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: IN_PROGRESS for 2s [ 1185.382531] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.382703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.382956] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f786f00-aa6a-4cd9-84aa-84d80f602efa with status ACTIVE [ 1185.383195] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.383328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.383435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.383707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.383906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.384110] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.384230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.384303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.384501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.384597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.384810] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.384923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.384994] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.385183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.385277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.385392] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa is going to be updated. [ 1185.407941] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.408618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.408700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.408960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.409130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.409722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.426946] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1185.427128] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 deletion is rescheduled due to dependency. [ 1185.427248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.427413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.427620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.427808] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.427926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.427989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.428157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.428236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.430778] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.636453] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.743115] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf43cf95-d5e3-4ee6-aede-a91dff066d6a: rpc.has_security_group_logging(os_id): False [ 1185.760611] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.760807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.760847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.761161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.761254] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.761476] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.761674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.761674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.761794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.761841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.762030] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.762161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.762253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.762300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.762379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.762722] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.762813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.762876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.763099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.763191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.763280] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be updated. [ 1185.826328] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.826744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.826744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.826744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.826948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.847023] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: IN_PROGRESS for 2s [ 1185.931322] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.138555] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.434226] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.644451] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.644638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.644795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.645110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.645237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.645367] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1186.675105] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.675330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.675386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.675587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.675841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.685355] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1186.937655] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.937937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.937937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.938110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.938200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.938301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1186.970685] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.970809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.970809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.970981] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.971153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.981236] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1187.344928] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 in Status: SUCCESS [ 1187.345176] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 deletion is rescheduled due to dependency. [ 1187.345311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.860881] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a in Status: SUCCESS [ 1187.861214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.861479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.861834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.862065] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf43cf95-d5e3-4ee6-aede-a91dff066d6a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.383671] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.384119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.384119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.384119] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.384265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.384301] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf43cf95-d5e3-4ee6-aede-a91dff066d6a is going to be deleted. [ 1188.445275] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.445458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.445538] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.445748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.445840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.445957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf43cf95-d5e3-4ee6-aede-a91dff066d6a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.695988] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1188.696253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.991532] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1188.991806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.992050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.992298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.992572] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.992732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.992793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.992989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.993099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.993228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.993368] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.497505] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.000600] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba84537-4aba-48c8-aa91-19210e1c0cf1: rpc.has_security_group_logging(os_id): False [ 1190.029449] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.029449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.029449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.029643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.029730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.029974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.030083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.030144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.030883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.030883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.030883] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1190.095745] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.095919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.095957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.096257] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.096513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.109385] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1190.131952] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.132401] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1192.132828] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1192.133325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.941670] env[65222]: INFO networking_nsxv3.common.synchronization [req-4f48e111-6eb3-45a9-9544-a86c1bbe3ee9 req-2e201ec2-d3e6-48a2-87c0-ab66beefefbf tempest-ServersTestJSON-1152720777 tempest-ServersTestJSON-1152720777-project-member] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1193.943792] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGHEST for action security_group_members [ 1193.943792] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.943967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.943967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.944164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.944355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.944463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.944527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.944681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.944788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.944909] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.448428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.448428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.448428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.448724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.448877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.449306] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.449431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.449477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.449733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.449884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.450043] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be updated. [ 1194.482545] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.482832] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.482993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.483260] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.483634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.494668] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: IN_PROGRESS for 2s [ 1196.507179] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc in Status: SUCCESS [ 1196.507573] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc deletion is rescheduled due to dependency. [ 1196.507573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.475610] env[65222]: INFO networking_nsxv3.common.synchronization [req-45b92c12-0341-4595-8329-7ac68a5c1a50 req-b39b3c36-e8a6-4219-b53c-ffcf8908a18f tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1198.475913] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1198.475949] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.476083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.476149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.476342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.476491] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.476585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.476644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.476785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.476875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.476963] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.979233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.979391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.979474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.979955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.001830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.002117] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.002236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.002309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.002502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.002621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.002681] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1199.034675] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.034888] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.034942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.035157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.035279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.045218] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1201.057568] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1201.057971] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 deletion is rescheduled due to dependency. [ 1201.057971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.476376] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.476376] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1206.959255] env[65222]: INFO networking_nsxv3.common.synchronization [req-2689e474-1bf2-4311-8ed4-c02481567ac4 req-e5dd6f87-1105-4a3e-a166-0db56523fb19 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1206.959600] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1206.959850] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.959971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.960046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.960248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.960405] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.960863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.960934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.961130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.961222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.961316] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.259249] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.259550] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.259647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.259923] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.260202] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.260382] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.260514] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.260722] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.261210] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.261210] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.261210] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.261396] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.261446] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.261532] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.261632] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.261784] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.283454] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.283614] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1207.283816] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.284081] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.284395] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-a33bff0d-5ab6-4eed-bc01-988618f4d623 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.284564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.284681] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.285239] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.285481] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a33bff0d-5ab6-4eed-bc01-988618f4d623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.464104] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.464338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.464338] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.464527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.464626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.464830] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.464931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.464997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.465171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.465247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.465338] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1207.492905] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.493125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.493125] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.493330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.493464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.502449] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1207.788320] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.788548] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.788718] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.789104] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.789301] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.789506] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port a33bff0d-5ab6-4eed-bc01-988618f4d623 not found, creating... [ 1207.789848] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.790080] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.790252] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.790529] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.790714] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.791125] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.791335] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.791494] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.791754] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.792040] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.792271] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: a33bff0d-5ab6-4eed-bc01-988618f4d623 is going to be created. [ 1207.812990] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.813210] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.813336] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.813601] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.813833] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.814098] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.510142] env[65222]: INFO networking_nsxv3.common.synchronization [req-2689e474-1bf2-4311-8ed4-c02481567ac4 req-6eb0836c-10f4-4117-85fc-1cdc5ad9df08 service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 1208.510418] env[65222]: INFO networking_nsxv3.common.synchronization [req-2689e474-1bf2-4311-8ed4-c02481567ac4 req-6eb0836c-10f4-4117-85fc-1cdc5ad9df08 service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1208.510482] env[65222]: INFO networking_nsxv3.common.synchronization [req-2689e474-1bf2-4311-8ed4-c02481567ac4 req-6eb0836c-10f4-4117-85fc-1cdc5ad9df08 service nova] Enqueued Resource ID: a33bff0d-5ab6-4eed-bc01-988618f4d623 with Priority: HIGHEST for action port [ 1208.510989] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 1208.511144] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1208.511237] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33bff0d-5ab6-4eed-bc01-988618f4d623 with Priority: HIGHEST for action port [ 1208.511574] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.511723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.511831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.512113] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.512227] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.513957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.513957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.513957] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-a33bff0d-5ab6-4eed-bc01-988618f4d623 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.513957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.513957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.513957] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.513957] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a33bff0d-5ab6-4eed-bc01-988618f4d623',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.017543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.017543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.018536] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a33bff0d-5ab6-4eed-bc01-988618f4d623 with status ACTIVE [ 1209.018536] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.018536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.018536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.018536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.018536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.018940] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.018940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.018940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.019096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.019096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.019381] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.019483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.019545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.019689] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.019760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.019854] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a33bff0d-5ab6-4eed-bc01-988618f4d623 is going to be updated. [ 1209.040749] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.040945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.040945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.041160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.041300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.041464] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a33bff0d-5ab6-4eed-bc01-988618f4d623" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.513046] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1209.513046] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 deletion is rescheduled due to dependency. [ 1209.513046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.513046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.513525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.513525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.513619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.513619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.513749] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.513826] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.513960] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.017034] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.518023] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.022059] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.022059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.022059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.022059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.022059] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.022059] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1211.060289] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.060289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.060289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.060547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.060547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.071893] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1213.083689] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1213.084047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.084131] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.084353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.084545] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.084659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.084725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.084875] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.084956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.085053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.085143] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.512479] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1213.512709] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1213.587580] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.089586] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deb58d10-eb3b-46ea-87ea-d75bc77a65e2: rpc.has_security_group_logging(os_id): False [ 1214.107390] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.107581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.107581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.107803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.107891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.108168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.108270] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.108335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.108493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.108567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.108653] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1214.172274] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.172420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.172490] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.172716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.172869] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.186173] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1215.778371] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.778727] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.778727] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.778982] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.779299] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.779488] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.779614] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.779847] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.780019] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.780237] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.780358] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.780468] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.780582] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.780690] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.780801] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.780930] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.801866] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.802159] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.802313] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.802495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.802820] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-191f515f-0899-4557-b804-5777c7a4a23c taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.802992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.803294] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.803619] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.803765] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191f515f-0899-4557-b804-5777c7a4a23c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.200017] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1216.200272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.306622] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.306899] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.306967] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.307310] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.307478] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.307787] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.307951] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.308097] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.308343] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.308486] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.308780] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.308939] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.309075] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.309291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.309430] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.309578] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 191f515f-0899-4557-b804-5777c7a4a23c is going to be updated. [ 1216.331904] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.331904] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.332243] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.332370] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.332596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.333123] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.070203] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d14a1d8-962d-4a1a-a8f5-592cb7349c39 req-ad0a9819-4e25-41c1-a9fb-5bd5e213fa35 service nova] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1217.070479] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d14a1d8-962d-4a1a-a8f5-592cb7349c39 req-ad0a9819-4e25-41c1-a9fb-5bd5e213fa35 service nova] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1217.070513] env[65222]: INFO networking_nsxv3.common.synchronization [req-7d14a1d8-962d-4a1a-a8f5-592cb7349c39 req-ad0a9819-4e25-41c1-a9fb-5bd5e213fa35 service nova] Enqueued Resource ID: 191f515f-0899-4557-b804-5777c7a4a23c with Priority: HIGHEST for action port [ 1217.071185] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_rules [ 1217.071417] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1217.071562] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 191f515f-0899-4557-b804-5777c7a4a23c with Priority: HIGHEST for action port [ 1217.071851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.072052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.072690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.072920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.073014] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.075085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.075085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.075085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.075085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.075414] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.075414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.075414] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.075586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.075644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.075726] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.077316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-191f515f-0899-4557-b804-5777c7a4a23c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.077316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.077316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.077503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.077574] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191f515f-0899-4557-b804-5777c7a4a23c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.575745] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.575745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.578438] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.582275] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 191f515f-0899-4557-b804-5777c7a4a23c with status ACTIVE [ 1217.582745] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.582745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.582745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.582907] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.583065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.583270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.583402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.583504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.583652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.583732] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.583914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.584060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.584233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.584374] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.584453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.584640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 191f515f-0899-4557-b804-5777c7a4a23c is going to be updated. [ 1217.610032] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.610032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.610032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.610032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.610032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.610032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-191f515f-0899-4557-b804-5777c7a4a23c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.081248] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.583465] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.583692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.583692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.583931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.584074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.584218] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be updated. [ 1218.615626] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.615849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.615901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.616150] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.616339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.626024] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: IN_PROGRESS for 2s [ 1220.638030] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: SUCCESS [ 1220.638378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.638424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.638641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.638831] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.638945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.639021] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.639176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.639255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.639340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.639438] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.143936] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.647845] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e866eb-f557-4c7e-9b34-d03a12e7238b: rpc.has_security_group_logging(os_id): False [ 1221.668963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.669191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.669237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.669574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.692158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.692593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.692720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.692797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.693063] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.693233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.693374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be updated. [ 1221.755361] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.755659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.755659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.755883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.755963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.770278] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: IN_PROGRESS for 2s [ 1222.072272] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1222.072470] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1223.786288] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: SUCCESS [ 1223.786703] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.073668] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.074052] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1232.074858] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.075298] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.076444] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.076444] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.077925] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.077925] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.079370] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.079716] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.080037] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.080412] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1253.022188] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1253.022428] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:3 started [ 1256.288136] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.288473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.288820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.289096] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.289253] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.289367] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.289587] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.289733] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.289941] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.290061] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.290224] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.290357] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.290471] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.290579] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.290712] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.310135] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.310310] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1256.310446] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.310615] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-903" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.310906] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-2f786f00-aa6a-4cd9-84aa-84d80f602efa taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.311081] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.311198] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.311491] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.311632] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f786f00-aa6a-4cd9-84aa-84d80f602efa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.813898] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.814195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.814334] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.814665] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.814830] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.815118] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.815275] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.815389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815607] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815740] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.816030] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.816186] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.816300] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.816504] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.816632] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.816787] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa is going to be updated. [ 1256.838873] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.839187] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.839375] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.839645] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.839838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.840066] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.081506] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.081625] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.534708] env[65222]: INFO networking_nsxv3.common.synchronization [req-7fe9cb87-8ee0-4a3e-8969-19817d4e7c13 req-383ff1d0-c1c2-4932-85b1-4e43fd552730 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1257.534991] env[65222]: INFO networking_nsxv3.common.synchronization [req-7fe9cb87-8ee0-4a3e-8969-19817d4e7c13 req-383ff1d0-c1c2-4932-85b1-4e43fd552730 service nova] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1257.535105] env[65222]: INFO networking_nsxv3.common.synchronization [req-7fe9cb87-8ee0-4a3e-8969-19817d4e7c13 req-383ff1d0-c1c2-4932-85b1-4e43fd552730 service nova] Enqueued Resource ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa with Priority: HIGHEST for action port [ 1257.535552] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_rules [ 1257.535685] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1257.536171] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa with Priority: HIGHEST for action port [ 1257.536471] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.536597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.536722] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.536862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.536940] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.537824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.537929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.538028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.538127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.538270] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.538367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.538428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.538564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.538648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.538735] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.539863] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f786f00-aa6a-4cd9-84aa-84d80f602efa taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.539863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.539863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.539863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.539863] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f786f00-aa6a-4cd9-84aa-84d80f602efa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.042242] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.042242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.042404] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.043434] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f786f00-aa6a-4cd9-84aa-84d80f602efa with status ACTIVE [ 1258.043434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.043602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.043602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.043803] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.043958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.044076] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.044175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.044235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.044392] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.044512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.044697] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.044787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.044847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.044986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.045073] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.045157] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f786f00-aa6a-4cd9-84aa-84d80f602efa is going to be updated. [ 1258.066765] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.066995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.066995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.067179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.067309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.067471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f786f00-aa6a-4cd9-84aa-84d80f602efa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.547049] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.049272] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.049433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.049508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.049871] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.049962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.050081] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1259.079070] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.079258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.079334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.079549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.079692] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.089575] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1260.109099] env[65222]: INFO networking_nsxv3.common.synchronization [req-39e82b00-6e5c-4087-b44e-943e5f3e1aa1 req-b63822b9-0f15-41b0-9bcb-1025429869bf tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1260.109315] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGHEST for action security_group_members [ 1260.109976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.109976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.109976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.110352] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.110462] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.110594] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.110642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.110768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.110851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.110942] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.612801] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.613034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.613034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.613298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.633708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.634016] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.634144] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.634207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.634430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.634577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.634705] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e is going to be updated. [ 1260.662570] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.662933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.662933] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.663056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.663191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.673222] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: IN_PROGRESS for 2s [ 1261.100998] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1261.101251] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.101493] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.101675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.101873] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.101990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.102069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.102229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.102309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.102401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.102524] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.605499] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.107759] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba84537-4aba-48c8-aa91-19210e1c0cf1: rpc.has_security_group_logging(os_id): False [ 1262.126825] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.126983] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.127075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.127385] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.127488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.127791] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.127891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.127960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.128146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.128235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.128312] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1262.226040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.226269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.226269] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.226478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.226671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.243091] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1262.684937] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e in Status: SUCCESS [ 1262.685361] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e deletion is rescheduled due to dependency. [ 1262.685361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.258548] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1264.258548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.874457] env[65222]: INFO networking_nsxv3.common.synchronization [None req-a062e778-8265-40ea-88ed-1c25c90a3bcb tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1264.875128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1264.875467] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.875657] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.875720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.876036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.876162] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.968100] env[65222]: INFO networking_nsxv3.common.synchronization [None req-d8dd133d-1776-48f3-93f7-7deefaffd28a tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1264.968630] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1264.969016] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.969166] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.398174] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.398564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.398564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.398659] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.398693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.398796] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 already deleted. [ 1265.398882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.399044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.399202] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.399288] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.920734] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.920922] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.920962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.921177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.921271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.921374] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 already deleted. [ 1265.921456] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.970216] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.970618] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.474772] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d953004-ca24-4b4c-9326-1705a8927ef1 req-41e9dce7-3d40-40e1-b038-5afc7bad44de tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1270.475317] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1270.475629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.475751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.475820] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.476129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.476248] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.476348] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.476407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.476561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.476664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.476730] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.790991] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.791300] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.791485] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.791877] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.792264] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.792508] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.792692] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.793013] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.793234] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.793530] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.793704] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.793874] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.794075] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.794255] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.794419] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.794655] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.817127] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.817322] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.817420] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.817592] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-381" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.817939] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-027de89c-37b4-4519-a4fd-0e74a6a49f3e taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.818130] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.818250] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.818718] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.818930] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027de89c-37b4-4519-a4fd-0e74a6a49f3e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.979195] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.979617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.979617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.979687] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.979730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.979934] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.980050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.980107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.980258] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.980335] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.980423] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 already deleted. [ 1270.980503] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.322268] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.322622] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.322818] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.323143] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.323345] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.323516] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 027de89c-37b4-4519-a4fd-0e74a6a49f3e not found, creating... [ 1271.323799] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.323963] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.324095] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.324336] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.324471] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.324842] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.324999] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.325159] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.325339] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.325469] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.325633] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 027de89c-37b4-4519-a4fd-0e74a6a49f3e is going to be created. [ 1271.346602] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.346822] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.347047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.347317] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.347543] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.347770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.060854] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d953004-ca24-4b4c-9326-1705a8927ef1 req-f2c764f0-ea33-45e8-a814-e398c5a85c61 service nova] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1272.061156] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d953004-ca24-4b4c-9326-1705a8927ef1 req-f2c764f0-ea33-45e8-a814-e398c5a85c61 service nova] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1272.061223] env[65222]: INFO networking_nsxv3.common.synchronization [req-8d953004-ca24-4b4c-9326-1705a8927ef1 req-f2c764f0-ea33-45e8-a814-e398c5a85c61 service nova] Enqueued Resource ID: 027de89c-37b4-4519-a4fd-0e74a6a49f3e with Priority: HIGHEST for action port [ 1272.061709] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_rules [ 1272.061844] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1272.061940] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 027de89c-37b4-4519-a4fd-0e74a6a49f3e with Priority: HIGHEST for action port [ 1272.062233] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.062355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.062423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.062648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.062731] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.063577] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.064514] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.064514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.064923] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.065707] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-027de89c-37b4-4519-a4fd-0e74a6a49f3e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.065856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.065897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.066042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.066115] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027de89c-37b4-4519-a4fd-0e74a6a49f3e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.568454] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.568593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.568768] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.572367] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 027de89c-37b4-4519-a4fd-0e74a6a49f3e with status ACTIVE [ 1272.572592] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.573252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.573252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.573252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.573252] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.573438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.573513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.573574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.573725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.573797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.573969] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.574220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.574220] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.574310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.574343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.574474] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 027de89c-37b4-4519-a4fd-0e74a6a49f3e is going to be updated. [ 1272.596450] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.596605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.596675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.596878] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.597024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.597186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-027de89c-37b4-4519-a4fd-0e74a6a49f3e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.070812] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.575102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.575294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.575341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.575636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.575745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.575853] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 is going to be created. [ 1273.603469] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.603709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.603709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.603889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.604066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.615514] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: UNINITIALIZED for 2s [ 1274.288098] env[65222]: INFO networking_nsxv3.common.synchronization [req-20077ab7-4f1a-4179-a8b3-4b8841c8941d req-286bce51-718d-4c37-8083-969ebf72d4c2 tempest-ServerActionsTestOtherB-1017893221 tempest-ServerActionsTestOtherB-1017893221-project-member] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1274.288522] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGHEST for action security_group_members [ 1274.288825] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.288952] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.289034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.289231] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.289382] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.289476] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.289534] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.289688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.289771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.289865] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.793186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.793186] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.793186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.793618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.793618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.793618] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be updated. [ 1274.824790] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.824990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.825060] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.825235] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.825383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.837056] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: IN_PROGRESS for 2s [ 1274.930388] env[65222]: INFO networking_nsxv3.common.synchronization [req-93c80e1e-376f-4feb-948e-f8c5305f2640 req-4298513a-5b5a-452d-b6dc-4bf4ac8203c8 tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1274.930892] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGHEST for action security_group_members [ 1274.931246] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.931375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.931445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.931678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.931792] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.931939] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.932027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.932646] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.932746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.932849] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.435115] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.435455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.435455] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.435584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.435708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.435923] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.436378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.436378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.436378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.436378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.436637] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be updated. [ 1275.464090] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.464285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.464285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.464539] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.464728] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.473530] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: IN_PROGRESS for 2s [ 1275.625070] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: SUCCESS [ 1275.625310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.625475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.625715] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.625918] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.626051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.626117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.626278] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.626362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.626450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.626542] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.128951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.631437] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afd30a92-4620-4e3f-a6da-5b25a5af9a83: rpc.has_security_group_logging(os_id): False [ 1276.649679] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.649881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.649881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.650127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.650218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.650454] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.650553] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.650618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.650843] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.650923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.651020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 is going to be created. [ 1276.706921] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.707188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.707188] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.707331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.707512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.717568] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: IN_PROGRESS for 2s [ 1276.847230] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 in Status: SUCCESS [ 1276.847428] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 deletion is rescheduled due to dependency. [ 1276.847525] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.483823] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b in Status: SUCCESS [ 1277.483823] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b deletion is rescheduled due to dependency. [ 1277.484181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.732827] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: SUCCESS [ 1278.733246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.931907] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.932221] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.847145] env[65222]: INFO networking_nsxv3.common.synchronization [None req-26fc3c62-7c7e-4f29-95b7-bca35628062c tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1281.847684] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1281.847788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.847908] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.847973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.848249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.848344] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.932027] env[65222]: INFO networking_nsxv3.common.synchronization [None req-e3fc24b4-df9a-40a1-8353-ca6644e7fab4 tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1281.932240] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1281.932845] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.933011] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.371022] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.371250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.371327] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.371560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.371653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.371761] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 already deleted. [ 1282.372365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.372365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.372365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.372365] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.895904] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.896266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.896266] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.896596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.896725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.896871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 already deleted. [ 1282.896971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.133971] env[65222]: INFO networking_nsxv3.common.synchronization [req-156cda0f-333a-4e85-a5ed-51b5ed29542e req-4ae8be40-4341-4595-8678-879ce4b65e72 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1285.134511] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGHEST for action security_group_members [ 1285.134879] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.135015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.135411] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.135656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.135851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.135966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.136056] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.136246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.136310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.136369] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.638268] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.638486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.638565] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.638840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.663174] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.663465] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.663588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.663652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.663884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.663972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.664078] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d is going to be updated. [ 1285.693172] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.693431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.693431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.693655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.693805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.703934] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: IN_PROGRESS for 2s [ 1287.417189] env[65222]: INFO networking_nsxv3.common.synchronization [req-f0852f1a-5969-4fda-9797-632beedabf8a req-0b6f401d-e8c1-464e-8d7a-900136224580 tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1287.418094] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1287.418094] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.418491] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.418583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.418823] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.418982] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.419096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.419160] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.419310] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.419394] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.419488] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.702640] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.702640] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.702898] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.703110] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.703376] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.703534] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.703646] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.703878] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.704032] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.704244] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.704356] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1287.704486] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1287.704595] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1287.704704] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.704837] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1287.704980] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1287.721460] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d in Status: SUCCESS [ 1287.721622] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d deletion is rescheduled due to dependency. [ 1287.721744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.727729] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1287.727962] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1287.728086] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1287.728231] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.728543] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-3cd77ba1-5d3c-4400-85da-46242e9852c7 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.728708] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.728824] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.729180] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.729316] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd77ba1-5d3c-4400-85da-46242e9852c7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.921723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.921723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.921723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.922016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.922117] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.922326] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.922426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.922426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.922541] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.922653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.922807] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 already deleted. [ 1287.922807] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.177873] env[65222]: INFO networking_nsxv3.common.synchronization [req-cb94ecc4-aa28-4de5-bc9f-976792c32101 req-d97b269a-2df1-4374-9d29-fbfc7dc03490 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1288.178483] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1288.178798] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.178953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.179017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.179388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.179564] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.179644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.179706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.179861] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.180613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.180613] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.231303] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.231515] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.231592] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.231876] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.232045] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.232214] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 3cd77ba1-5d3c-4400-85da-46242e9852c7 not found, creating... [ 1288.232532] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.232643] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.232744] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.233015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.233171] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.233452] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.233606] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.233721] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.233923] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.234092] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.234246] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 is going to be created. [ 1288.255022] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.255413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.255413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.255662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.255922] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.256177] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.682012] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.682445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.682445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.682517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.682599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.682826] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.682938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.683016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.683172] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.683261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.683351] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1288.714513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.714668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.714714] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.715009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.715156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.723546] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1288.975602] env[65222]: INFO networking_nsxv3.common.synchronization [req-f0852f1a-5969-4fda-9797-632beedabf8a req-6196123e-1b0c-4b83-bbce-2d131b0900bb service nova] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1288.975775] env[65222]: INFO networking_nsxv3.common.synchronization [req-f0852f1a-5969-4fda-9797-632beedabf8a req-6196123e-1b0c-4b83-bbce-2d131b0900bb service nova] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1288.975914] env[65222]: INFO networking_nsxv3.common.synchronization [req-f0852f1a-5969-4fda-9797-632beedabf8a req-6196123e-1b0c-4b83-bbce-2d131b0900bb service nova] Enqueued Resource ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 with Priority: HIGHEST for action port [ 1288.976503] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1288.976717] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1288.976808] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 with Priority: HIGHEST for action port [ 1288.977382] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.977453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.977504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.977702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.977785] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.978608] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.979020] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.979099] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.979265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.979425] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.979527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.979589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.979765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.979816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.979900] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.981922] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd77ba1-5d3c-4400-85da-46242e9852c7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.982046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.982126] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.982318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.982394] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd77ba1-5d3c-4400-85da-46242e9852c7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.483620] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.484875] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.484993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.485193] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cd77ba1-5d3c-4400-85da-46242e9852c7 with status ACTIVE [ 1289.485355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.485486] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.485555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.485754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.485841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.486075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.486294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.486360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.486527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.486604] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.486796] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.486913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.486977] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.488058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.488058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.488058] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 is going to be updated. [ 1289.509806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.510019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.510019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.510227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.510361] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.510510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.967629] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.968033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.968033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.968293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.968397] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.990689] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.471442] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.493204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.493367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.493513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.493679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.493773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.493871] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be created. [ 1290.519490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.519636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.519693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.519934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.520084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.531111] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: UNINITIALIZED for 2s [ 1290.733736] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1290.733736] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 deletion is rescheduled due to dependency. [ 1290.733904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.973840] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.477133] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1291.477133] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1292.189505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.189938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.189938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.189938] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.204247] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1292.205209] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.206390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1292.242415] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.242650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.242650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.242847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.256685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.257648] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1292.257730] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.257825] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1292.296081] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.296232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.296324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.296542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.297545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.297715] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1292.369704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.369944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.369944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.370136] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.370443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.370708] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1292.445171] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.445388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.445388] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.445581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.445920] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.446235] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 1292.446327] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'309c514b-b141-440e-916b-43a229296f1d', '06e866eb-f557-4c7e-9b34-d03a12e7238b', 'deb58d10-eb3b-46ea-87ea-d75bc77a65e2', 'ac028803-c2f2-4ce0-97e9-bd69f4396d9e', 'e05a7a00-b8fe-40b0-96db-3fd1b570f076', 'a50b6578-c051-4750-b9bb-002f9ba016ff', '806c8c4c-c741-481d-b9ad-0da164be396a', 'd6e292cc-368f-4af4-9a2c-e739a92ac09e', '4e1731f5-1d9f-462a-ae44-ca3b648159b6', 'ccc4281e-6879-475e-a747-7907ebd40b7f', 'a5069f7f-5460-4aba-91e3-1ff69c00f601', '36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504', '6ba84537-4aba-48c8-aa91-19210e1c0cf1', '4eb5605d-d158-4afb-b319-53f3e5ce181c', '6e3fb04a-0d3f-4197-972f-8af0b18716d2', 'cc553a02-1011-453d-afd5-508e6b6203b1', '7cdeb067-1c84-46bf-b468-65ab19cb86dc', 'bbaddab6-0327-438e-a968-548042cf4e7a', 'a1afa0b0-3cbd-4920-98be-230a695a0592', '034ec8fb-de90-4302-acab-f4bec595dd2d', 'bedc55f5-0ad2-4b84-aab1-d26ca6737e7a', '6355cca5-8c96-4bbb-bc95-01de745d5b8c', '0d779a56-b08e-4d96-a298-035aff7f597c', '15ef4155-817c-4a1e-8484-6fde2baef247', '124a99d3-fe24-481b-88c5-184d5a1c99ee', '67a33950-b193-4a08-b38a-6d6532bafae7', 'afd30a92-4620-4e3f-a6da-5b25a5af9a83', '4a1f130e-cc8b-4415-87be-b7a8cbdda189', '18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d', '6f6b2a52-a6df-4aec-9cd6-da7e43f26431', '3611c6f7-c786-4748-b4fa-faf7bcfceab1', '44afacd5-bc37-4272-9409-ec05ce0c00f8', 'a055c4f3-b6b2-41d3-9478-9a1e5a156588', '3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3', 'b27543c2-5369-4055-8e1e-f614903e057b', 'a4c36af1-3224-4449-b91e-20d98bbff745', '2fbc24f1-8254-4b9b-9b11-d6605f74d8db', '8e8b0390-6b22-4e1a-92fa-1046e5b93e83'} {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.446431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1292.474927] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.475161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.475161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.475362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.475446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.475559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1292.475631] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.475702] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1292.540075] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: SUCCESS [ 1292.540201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.540321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.540902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.540902] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.540902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.540902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.541142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.541142] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.541205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.541257] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.549460] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.549598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.549666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.549852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.550966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.551279] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1292.551359] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.551446] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1292.551497] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1292.551577] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 1292.551630] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGH for action security_group_rules [ 1292.551709] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGH for action security_group_rules [ 1292.551774] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1292.551835] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGH for action security_group_rules [ 1292.551895] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGH for action security_group_rules [ 1292.551955] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGH for action security_group_rules [ 1292.552091] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGH for action security_group_rules [ 1292.552091] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGH for action security_group_rules [ 1292.552199] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGH for action security_group_rules [ 1292.552199] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGH for action security_group_rules [ 1292.552260] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGH for action security_group_rules [ 1292.552316] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGH for action security_group_rules [ 1292.552361] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGH for action security_group_rules [ 1292.552420] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGH for action security_group_rules [ 1292.552481] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGH for action security_group_rules [ 1292.552543] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGH for action security_group_rules [ 1292.552601] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGH for action security_group_rules [ 1292.552668] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGH for action security_group_rules [ 1292.552755] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGH for action security_group_rules [ 1292.552843] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGH for action security_group_rules [ 1292.552943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.044452] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.546908] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecd15111-3c7c-4713-899a-8f4cf2bf2825: rpc.has_security_group_logging(os_id): False [ 1293.565162] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.565330] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.565376] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.565583] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.565672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.565914] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.566028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.566092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.566249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.566323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.566407] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be created. [ 1293.633591] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.633720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.633720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.634014] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.634206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.647966] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: IN_PROGRESS for 2s [ 1293.977959] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.978141] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1293.978300] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309c514b-b141-440e-916b-43a229296f1d with Priority: HIGH for action security_group_rules [ 1293.978431] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1293.978533] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806c8c4c-c741-481d-b9ad-0da164be396a with Priority: HIGH for action security_group_rules [ 1293.978630] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 with Priority: HIGH for action security_group_rules [ 1293.978727] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034ec8fb-de90-4302-acab-f4bec595dd2d with Priority: HIGH for action security_group_rules [ 1293.978822] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1afa0b0-3cbd-4920-98be-230a695a0592 with Priority: HIGH for action security_group_rules [ 1293.978914] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaddab6-0327-438e-a968-548042cf4e7a with Priority: HIGH for action security_group_rules [ 1293.979014] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc with Priority: HIGH for action security_group_rules [ 1293.979102] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c with Priority: HIGH for action security_group_rules [ 1293.979199] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc553a02-1011-453d-afd5-508e6b6203b1 with Priority: HIGH for action security_group_rules [ 1293.979277] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 with Priority: HIGH for action security_group_rules [ 1293.979363] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 with Priority: HIGH for action security_group_rules [ 1293.979458] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 with Priority: HIGH for action security_group_rules [ 1293.979553] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGH for action security_group_rules [ 1293.979639] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 with Priority: HIGH for action security_group_rules [ 1293.980214] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b6578-c051-4750-b9bb-002f9ba016ff with Priority: HIGH for action security_group_rules [ 1293.980363] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e with Priority: HIGH for action security_group_rules [ 1293.980475] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 with Priority: HIGH for action security_group_rules [ 1293.980573] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b with Priority: HIGH for action security_group_rules [ 1293.980677] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e with Priority: HIGH for action security_group_rules [ 1293.981093] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309c514b-b141-440e-916b-43a229296f1d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.981246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.981316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.981543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.981626] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309c514b-b141-440e-916b-43a229296f1d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.983400] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.983527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.983640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.983828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.983906] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.985452] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-806c8c4c-c741-481d-b9ad-0da164be396a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.985599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.985669] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.986471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.986624] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('806c8c4c-c741-481d-b9ad-0da164be396a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.987505] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.987606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.987672] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.987827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.987901] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e3fb04a-0d3f-4197-972f-8af0b18716d2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.988656] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-034ec8fb-de90-4302-acab-f4bec595dd2d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.988765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.988837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.988988] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.989073] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('034ec8fb-de90-4302-acab-f4bec595dd2d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.991856] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1afa0b0-3cbd-4920-98be-230a695a0592 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.991971] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.992046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.992148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.992223] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1afa0b0-3cbd-4920-98be-230a695a0592',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.992919] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaddab6-0327-438e-a968-548042cf4e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.993035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.993120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.993768] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.993768] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaddab6-0327-438e-a968-548042cf4e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.993924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.994036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.994097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.994718] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.994718] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdeb067-1c84-46bf-b468-65ab19cb86dc',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.995101] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb5605d-d158-4afb-b319-53f3e5ce181c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.995206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.995358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.995418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.995473] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb5605d-d158-4afb-b319-53f3e5ce181c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.996247] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc553a02-1011-453d-afd5-508e6b6203b1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.996358] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.996405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.996551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.996622] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc553a02-1011-453d-afd5-508e6b6203b1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.997489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.997489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.997489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.997668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.997668] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba84537-4aba-48c8-aa91-19210e1c0cf1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.998307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.998408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.998474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.998622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.998692] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.999365] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5069f7f-5460-4aba-91e3-1ff69c00f601 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.999467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.999515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.999632] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.999693] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5069f7f-5460-4aba-91e3-1ff69c00f601',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.000500] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.000577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.000577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.000721] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.000837] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.001473] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.001563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.001602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.001733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.001818] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1731f5-1d9f-462a-ae44-ca3b648159b6',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.002603] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50b6578-c051-4750-b9bb-002f9ba016ff taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.002603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.002759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.002800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.002884] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50b6578-c051-4750-b9bb-002f9ba016ff',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.003645] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.003772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.003929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.003999] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e292cc-368f-4af4-9a2c-e739a92ac09e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.004647] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.004759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.004854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.005058] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.005170] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e05a7a00-b8fe-40b0-96db-3fd1b570f076',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.005868] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e866eb-f557-4c7e-9b34-d03a12e7238b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.006094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.006161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.007024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.007024] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e866eb-f557-4c7e-9b34-d03a12e7238b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.007138] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.007196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.007228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.007405] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.007467] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac028803-c2f2-4ce0-97e9-bd69f4396d9e',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.031761] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.031930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.032046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.032256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.052571] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.052740] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb5605d-d158-4afb-b319-53f3e5ce181c is going to be deleted. [ 1294.107504] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.107637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.107790] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.108030] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.108090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.108201] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb5605d-d158-4afb-b319-53f3e5ce181c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.507307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.507518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.507518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.507723] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.515135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.515323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.559902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.560325] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be deleted. [ 1294.569115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.569499] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.583277] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.583480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.584345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.584458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.585304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.585478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.586168] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.586274] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.587153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.587343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.587936] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.588043] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.588756] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.588853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.589554] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.589640] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.592507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.592634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.593394] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.593485] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.594108] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.594514] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.594607] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.595256] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.595639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.595748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.597648] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.598054] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.598177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.600098] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.600468] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.600562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.601825] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.602262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.602368] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.606837] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.607308] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.607408] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.615579] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.615837] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.616052] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309c514b-b141-440e-916b-43a229296f1d is going to be deleted. [ 1294.617035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.617287] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.619157] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.619342] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.639149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.639373] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1731f5-1d9f-462a-ae44-ca3b648159b6 is going to be deleted. [ 1294.640208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.640426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.659395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.659551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.664863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.665020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e866eb-f557-4c7e-9b34-d03a12e7238b is going to be deleted. [ 1294.666194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.666475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.686773] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.686965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.709515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.709694] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e3fb04a-0d3f-4197-972f-8af0b18716d2 is going to be deleted. [ 1294.710560] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.710767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.712156] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.712315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.734915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.735079] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1afa0b0-3cbd-4920-98be-230a695a0592 is going to be deleted. [ 1294.735986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.736190] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.738189] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.738333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.798974] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.799151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.810940] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.811554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.811692] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5069f7f-5460-4aba-91e3-1ff69c00f601 is going to be deleted. [ 1294.812735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.812993] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.870833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.871029] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504 is going to be deleted. [ 1294.871899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.872137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.873599] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.873706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.921211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.921513] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50b6578-c051-4750-b9bb-002f9ba016ff is going to be deleted. [ 1294.922267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.922502] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.975032] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.975253] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be deleted. [ 1294.976289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.976535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.988322] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.988528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.001295] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.001295] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.039249] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.039395] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc553a02-1011-453d-afd5-508e6b6203b1 is going to be deleted. [ 1295.040469] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.040633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.058141] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.058377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.065297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.065437] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e292cc-368f-4af4-9a2c-e739a92ac09e is going to be deleted. [ 1295.067158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.067158] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.080637] env[65222]: INFO networking_nsxv3.common.synchronization [req-21827a7f-dcb7-436a-97ea-96cfb37d9909 req-22a98ac7-fb07-406f-96d2-0c7ea1045a53 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1295.080836] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1295.081256] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.081256] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.081366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.081519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.081665] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.081764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.081842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.082015] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.082151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.082274] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.104509] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.104678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.109279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.109414] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e05a7a00-b8fe-40b0-96db-3fd1b570f076 is going to be deleted. [ 1295.110421] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.110662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.138880] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.139028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.172800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.173090] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 806c8c4c-c741-481d-b9ad-0da164be396a is going to be deleted. [ 1295.174114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.174435] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.209542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.209542] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 034ec8fb-de90-4302-acab-f4bec595dd2d is going to be deleted. [ 1295.210369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.210369] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.244424] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.244424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.244424] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.244424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.253069] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.253069] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdeb067-1c84-46bf-b468-65ab19cb86dc is going to be deleted. [ 1295.253928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.254263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.299975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.300453] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaddab6-0327-438e-a968-548042cf4e7a is going to be deleted. [ 1295.301630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.301630] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.314290] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.314449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.349711] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.349852] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.351511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.351640] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac028803-c2f2-4ce0-97e9-bd69f4396d9e is going to be deleted. [ 1295.352620] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.352919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.405317] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.405497] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.406621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.406757] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba84537-4aba-48c8-aa91-19210e1c0cf1 is going to be deleted. [ 1295.407656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.407899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.408211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.408433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.409678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.409678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.409678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.409678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309c514b-b141-440e-916b-43a229296f1d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.409844] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.409930] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.409989] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.410123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1731f5-1d9f-462a-ae44-ca3b648159b6" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.410277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.410431] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.410536] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.410654] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e866eb-f557-4c7e-9b34-d03a12e7238b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.410812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.411261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.411261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.411318] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e3fb04a-0d3f-4197-972f-8af0b18716d2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.411415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.411578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.411656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.411766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1afa0b0-3cbd-4920-98be-230a695a0592" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.411899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.412048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.412122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.412232] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36fc4902-01d0-4ac9-9cf2-6fbcc5fc0504" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.412355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.412492] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.412562] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.412684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5069f7f-5460-4aba-91e3-1ff69c00f601" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.412828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.412976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.413084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.413215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50b6578-c051-4750-b9bb-002f9ba016ff" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.413341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.413477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.413549] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.413655] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.413773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.413909] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.413980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.414090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc553a02-1011-453d-afd5-508e6b6203b1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.414211] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.414344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.414506] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.414628] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e292cc-368f-4af4-9a2c-e739a92ac09e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.414752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.415091] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.415186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.415309] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e05a7a00-b8fe-40b0-96db-3fd1b570f076" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.415449] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.415609] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.415694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.415885] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-806c8c4c-c741-481d-b9ad-0da164be396a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.416088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.416245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.416322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.416441] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-034ec8fb-de90-4302-acab-f4bec595dd2d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.416570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.416713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.416789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.416894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdeb067-1c84-46bf-b468-65ab19cb86dc" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.432704] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.432896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.433033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.433302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.433400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.433520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaddab6-0327-438e-a968-548042cf4e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.440492] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.440730] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.440859] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.441091] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.441364] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.441523] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.441638] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.441862] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.442025] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.442248] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1295.442374] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1295.442480] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1295.442583] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1295.442725] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1295.442862] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1295.442974] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1295.481510] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1295.481688] env[65222]: DEBUG dogpile.cache.region [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1295.481811] env[65222]: DEBUG dogpile.lock [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1295.481991] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "network-303" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.482341] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock port-35b639d4-4347-489f-881e-14d55d080522 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.482520] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.482647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.483145] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.483269] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b639d4-4347-489f-881e-14d55d080522',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.508762] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.508970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.509050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.509242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.509340] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.509465] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac028803-c2f2-4ce0-97e9-bd69f4396d9e" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.547724] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1295.548373] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.548519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.548567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.548889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.548999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.549145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba84537-4aba-48c8-aa91-19210e1c0cf1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.585199] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.585617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.585617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.585794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.585925] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.586219] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.586355] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.586450] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.586676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.586789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.587020] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be deleted. [ 1295.643131] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.643320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.643320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.643518] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.643596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.643696] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.681576] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: SUCCESS [ 1295.681848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.985826] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.986147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.986347] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.986714] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.986924] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.987187] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Segment Port 35b639d4-4347-489f-881e-14d55d080522 not found, creating... [ 1295.987566] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.987786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.987953] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.988269] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.988462] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.988870] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.989097] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.989282] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.989582] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.989770] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.989964] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Resource: SegmentPort with ID: 35b639d4-4347-489f-881e-14d55d080522 is going to be created. [ 1296.014053] env[65222]: DEBUG networking_nsxv3.common.locking [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.014336] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.014507] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.014865] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.015156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.015414] env[65222]: DEBUG oslo_concurrency.lockutils [None req-760b577f-16d2-4136-89f4-8795f5246bdb None None] Releasing lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.684484] env[65222]: INFO networking_nsxv3.common.synchronization [req-21827a7f-dcb7-436a-97ea-96cfb37d9909 req-3b2486fd-ed27-48ea-937c-5d389e7a7234 service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 1296.684746] env[65222]: INFO networking_nsxv3.common.synchronization [req-21827a7f-dcb7-436a-97ea-96cfb37d9909 req-3b2486fd-ed27-48ea-937c-5d389e7a7234 service nova] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1296.684948] env[65222]: INFO networking_nsxv3.common.synchronization [req-21827a7f-dcb7-436a-97ea-96cfb37d9909 req-3b2486fd-ed27-48ea-937c-5d389e7a7234 service nova] Enqueued Resource ID: 35b639d4-4347-489f-881e-14d55d080522 with Priority: HIGHEST for action port [ 1296.685533] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_rules [ 1296.685698] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1296.685839] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b639d4-4347-489f-881e-14d55d080522 with Priority: HIGHEST for action port [ 1296.686165] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.686311] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.686386] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.686623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.686725] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.688279] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.688383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.688463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.688675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.688850] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.688968] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.689078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.689926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.689926] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.689926] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.690274] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-35b639d4-4347-489f-881e-14d55d080522 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.690417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.690417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.690979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.690979] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b639d4-4347-489f-881e-14d55d080522',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.182234] env[65222]: INFO networking_nsxv3.common.synchronization [req-92c2779e-fda5-40ff-9731-eb90c71e71a4 req-9a7e35b7-9583-456a-aead-40bb694b405e tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1297.183037] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1297.183358] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.183480] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.183544] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.183739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.183888] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.183987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.184360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.184537] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.184627] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.184723] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.192717] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.193525] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.193636] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.193769] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35b639d4-4347-489f-881e-14d55d080522 with status ACTIVE [ 1297.193924] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.194045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.194111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.194294] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.194381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.195963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.195963] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.195963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.195963] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35b639d4-4347-489f-881e-14d55d080522 is going to be updated. [ 1297.217538] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.217697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.217740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.217931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.218079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.218238] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35b639d4-4347-489f-881e-14d55d080522" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.476597] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.476835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.477061] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.477365] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.477665] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.477847] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.477983] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.478251] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.478421] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.478659] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.478794] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1297.478912] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1297.479056] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1297.479239] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.479308] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1297.479441] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1297.498256] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1297.498460] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1297.498621] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1297.498822] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.499195] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-56bee876-9595-4ca6-a58d-1062e49e7009 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.499402] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.499537] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.499897] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.500082] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bee876-9595-4ca6-a58d-1062e49e7009',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.687212] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.687624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.687624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.687806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.687929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.688187] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.688315] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.688396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.688725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.688725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.688805] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be deleted. [ 1297.697611] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.719527] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.719731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.719731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.720012] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.720148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.720717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.002988] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.002988] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.003156] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.003470] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.003626] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.003779] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 56bee876-9595-4ca6-a58d-1062e49e7009 not found, creating... [ 1298.004134] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.004299] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.004416] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.004731] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.004795] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.005081] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.005237] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.005354] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.005556] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.005686] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.005909] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 56bee876-9595-4ca6-a58d-1062e49e7009 is going to be created. [ 1298.026051] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.026274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.026402] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.026669] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.026889] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.027132] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.200408] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.200639] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.200690] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.201114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.201279] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.201431] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be created. [ 1298.228462] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.228764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.228764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.229077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.229265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.239720] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: UNINITIALIZED for 2s [ 1298.731308] env[65222]: INFO networking_nsxv3.common.synchronization [req-92c2779e-fda5-40ff-9731-eb90c71e71a4 req-01868dc7-236c-4e2d-aedf-c979ae245724 service nova] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_rules [ 1298.731696] env[65222]: INFO networking_nsxv3.common.synchronization [req-92c2779e-fda5-40ff-9731-eb90c71e71a4 req-01868dc7-236c-4e2d-aedf-c979ae245724 service nova] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1298.731696] env[65222]: INFO networking_nsxv3.common.synchronization [req-92c2779e-fda5-40ff-9731-eb90c71e71a4 req-01868dc7-236c-4e2d-aedf-c979ae245724 service nova] Enqueued Resource ID: 56bee876-9595-4ca6-a58d-1062e49e7009 with Priority: HIGHEST for action port [ 1298.732100] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_rules [ 1298.732228] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1298.732327] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56bee876-9595-4ca6-a58d-1062e49e7009 with Priority: HIGHEST for action port [ 1298.732590] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.732882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.732882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.732992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.733129] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.733915] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.734068] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.734156] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.734277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.734422] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.734548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.734713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.734789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.734889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.734960] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.736181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-56bee876-9595-4ca6-a58d-1062e49e7009 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.736293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.736384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.736556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.736634] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bee876-9595-4ca6-a58d-1062e49e7009',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.237609] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.240112] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.240228] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.240393] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56bee876-9595-4ca6-a58d-1062e49e7009 with status ACTIVE [ 1299.240557] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.240664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.240730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.240936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.241899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.241899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.241899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.241899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.241899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.241899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.241899] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.242272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.242272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.242272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.242272] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.242390] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56bee876-9595-4ca6-a58d-1062e49e7009 is going to be updated. [ 1299.264020] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.264205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.264244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.264451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.264585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.264746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.740515] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.242844] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.245709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.245709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.245709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.245709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.245709] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be created. [ 1300.255860] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1300.256283] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.256597] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.256928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.257198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.257326] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.257623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.257709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.257800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.257892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.258067] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.281201] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.281378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.281475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.281733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.281899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.300985] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: UNINITIALIZED for 2s [ 1300.760830] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.262838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deb58d10-eb3b-46ea-87ea-d75bc77a65e2: rpc.has_security_group_logging(os_id): False [ 1301.280814] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.280958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.281045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.281282] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.281413] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.281663] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.281766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.281829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.281986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.282074] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.282158] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be created. [ 1301.414560] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.414800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.414800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.415052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.415233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.430721] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1302.313027] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1302.313416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.313516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.313742] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.313942] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.314067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.314141] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.314297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.314375] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.314459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.314548] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.816982] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.817229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.817229] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.817460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.817623] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.817724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.817787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.817935] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.818094] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.818198] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.818350] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.818447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.818510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.818656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.818793] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.818880] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.818940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.819090] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.819168] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.819246] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.819336] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.321151] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccc4281e-6879-475e-a747-7907ebd40b7f: rpc.has_security_group_logging(os_id): False [ 1303.340664] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.340870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.340870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.341102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.341195] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.341418] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.341533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.341598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.341751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.341829] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.342047] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.342145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.342205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.342345] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.342417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.342594] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.342691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.342782] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.342969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.343079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.343169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be created. [ 1303.401567] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.401748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.401793] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.402016] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.402280] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.415401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: IN_PROGRESS for 2s [ 1303.444086] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1303.444341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.733416] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.733633] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1305.429950] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1305.430293] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.735251] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.735652] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.489719] env[65222]: INFO networking_nsxv3.common.synchronization [req-25a39b95-e7b6-4390-8ddb-07f09cd9faee req-93c1a27b-66f0-46f7-99ad-334fbc6759a7 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1309.490202] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGHEST for action security_group_members [ 1309.490494] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.490618] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.490684] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.490931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.491155] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.491267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.491328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.491521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.491615] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.491710] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.535477] env[65222]: INFO networking_nsxv3.common.synchronization [req-25a39b95-e7b6-4390-8ddb-07f09cd9faee req-93c1a27b-66f0-46f7-99ad-334fbc6759a7 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: 56bee876-9595-4ca6-a58d-1062e49e7009 with Priority: HIGHEST for action port [ 1309.536026] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56bee876-9595-4ca6-a58d-1062e49e7009 with Priority: HIGHEST for action port [ 1309.536379] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-56bee876-9595-4ca6-a58d-1062e49e7009 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.536531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.536641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.536899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.537139] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bee876-9595-4ca6-a58d-1062e49e7009',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.994281] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.994849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.994849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.994849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.994849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.995099] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.995214] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.995277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.995509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.995599] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.995746] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be updated. [ 1310.025833] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.026010] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.026087] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.026393] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.026554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.036336] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: IN_PROGRESS for 2s [ 1310.038729] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56bee876-9595-4ca6-a58d-1062e49e7009 with status ACTIVE [ 1310.039029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.039223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.039347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.039613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.039752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.039987] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.040161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.040271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.040527] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.040652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.040894] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.041071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.041212] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.041447] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.041598] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.041734] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56bee876-9595-4ca6-a58d-1062e49e7009 is going to be updated. [ 1310.067836] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.068050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.068050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.068281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.068417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.068577] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56bee876-9595-4ca6-a58d-1062e49e7009" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.046289] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccc4281e-6879-475e-a747-7907ebd40b7f in Status: SUCCESS [ 1312.046688] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f deletion is rescheduled due to dependency. [ 1312.046688] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.537244] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.537587] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.539100] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.539100] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.540025] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.540487] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.541484] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.541836] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.903532] env[65222]: INFO networking_nsxv3.common.synchronization [req-73dcabc8-23d5-49e2-8b83-c1a40cf6657e req-aa027c47-447e-4155-977e-48c6034f6601 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1333.904034] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1333.904329] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.904483] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.904519] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.904708] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.904912] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.905145] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.905255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.905424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.905511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.905603] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.169726] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.170047] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.170242] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.170564] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.170886] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.171061] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.171221] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.171473] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.171647] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.171888] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1334.172036] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1334.172177] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1334.172314] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1334.172465] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1334.172596] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1334.172757] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1334.193625] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1334.193789] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1334.193923] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1334.194109] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-633" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.194433] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-f75429a8-6d9f-488e-a9f4-4d356160c545 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.194596] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.194726] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.195035] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.195172] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f75429a8-6d9f-488e-a9f4-4d356160c545',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.407840] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.697696] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.697968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.698124] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.698453] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.698635] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.698797] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port f75429a8-6d9f-488e-a9f4-4d356160c545 not found, creating... [ 1334.699090] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.699260] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.699381] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.699628] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.699788] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.700097] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.700262] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.700382] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.700599] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.700742] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.700879] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: f75429a8-6d9f-488e-a9f4-4d356160c545 is going to be created. [ 1334.721354] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.721560] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.721682] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.721997] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.722240] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.722478] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.910441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.412992] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.413185] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.413255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.413745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.413745] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.413745] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be updated. [ 1335.419814] env[65222]: INFO networking_nsxv3.common.synchronization [req-73dcabc8-23d5-49e2-8b83-c1a40cf6657e req-4172ee79-e6f9-466f-860b-3760dda2a816 service nova] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1335.419990] env[65222]: INFO networking_nsxv3.common.synchronization [req-73dcabc8-23d5-49e2-8b83-c1a40cf6657e req-4172ee79-e6f9-466f-860b-3760dda2a816 service nova] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1335.420142] env[65222]: INFO networking_nsxv3.common.synchronization [req-73dcabc8-23d5-49e2-8b83-c1a40cf6657e req-4172ee79-e6f9-466f-860b-3760dda2a816 service nova] Enqueued Resource ID: f75429a8-6d9f-488e-a9f4-4d356160c545 with Priority: HIGHEST for action port [ 1335.420372] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_rules [ 1335.420497] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1335.420592] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75429a8-6d9f-488e-a9f4-4d356160c545 with Priority: HIGHEST for action port [ 1335.421153] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.421496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.421570] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.421767] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.421847] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.423489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.423489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.423489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-f75429a8-6d9f-488e-a9f4-4d356160c545 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.423489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.423489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.423738] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.423738] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f75429a8-6d9f-488e-a9f4-4d356160c545',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.441644] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.441923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.441923] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.442189] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.442331] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.451302] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1335.926033] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.926341] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.926435] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f75429a8-6d9f-488e-a9f4-4d356160c545 with status ACTIVE [ 1335.926668] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.926785] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.926855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.927084] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.927176] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.927352] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.927451] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.927564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.927691] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.927766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.927943] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.928051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.928112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.928247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.928321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.928405] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f75429a8-6d9f-488e-a9f4-4d356160c545 is going to be updated. [ 1335.949928] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.950216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.950216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.950353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.950423] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.950558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f75429a8-6d9f-488e-a9f4-4d356160c545" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.462967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1337.463460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.463460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.463596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.463804] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.463927] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.464013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.464165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.464248] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.464350] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.967254] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.470609] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.973355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.973638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.973727] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.974096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.974265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.974377] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be updated. [ 1339.004207] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.004351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.004412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.004621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.004772] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.015731] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1340.421677] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.422128] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1341.030292] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1341.030514] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.030685] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.030910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.031132] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.031281] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.031354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.031512] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.031593] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.031679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.031770] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.534583] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.037216] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b27543c2-5369-4055-8e1e-f614903e057b: rpc.has_security_group_logging(os_id): False [ 1342.056815] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.057071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.057071] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.057298] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.082471] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.082779] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.082902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.082970] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.083206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.083307] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.083401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be updated. [ 1342.147389] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.147617] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.147744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.148041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.148221] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.162815] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1344.179922] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1344.180226] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.422999] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.423274] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.987038] env[65222]: INFO networking_nsxv3.common.synchronization [req-6f0ab59e-7b23-4121-a808-512e7089a00b req-31ac7a11-0bbe-470a-8084-4121fc130813 tempest-AttachVolumeTestJSON-1284465588 tempest-AttachVolumeTestJSON-1284465588-project-member] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1349.987649] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGHEST for action security_group_members [ 1349.988018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.988159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.988230] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.988425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.988593] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.988662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.988730] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.988881] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.988966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.989082] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.491393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.491605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.491605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.491842] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.514702] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.514956] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.515098] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.515175] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.515454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.515561] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.515615] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 is going to be updated. [ 1350.543430] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.543610] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.543653] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.543839] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.543982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.553140] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: IN_PROGRESS for 2s [ 1352.565797] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 in Status: SUCCESS [ 1352.566193] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 deletion is rescheduled due to dependency. [ 1352.566193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.988468] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.988468] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.961491] env[65222]: INFO networking_nsxv3.common.synchronization [req-1574762c-f482-48b3-bcde-38e5d5983f62 req-89d480fc-0b17-4037-b23d-dcd626a54b64 tempest-ServerActionsTestJSON-2062031926 tempest-ServerActionsTestJSON-2062031926-project-member] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1358.962023] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGHEST for action security_group_members [ 1358.962671] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.962800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.962864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.963079] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.963239] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.963379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.963501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.963889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.963889] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.963889] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.466707] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.466707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.466707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.467024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.467065] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.467393] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.467558] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.467855] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.467936] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.468019] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.468158] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be updated. [ 1359.500824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.500995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.501053] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.501290] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.501595] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.513606] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: IN_PROGRESS for 2s [ 1361.524707] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 in Status: SUCCESS [ 1361.525111] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 deletion is rescheduled due to dependency. [ 1361.525111] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.266057] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.266436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.266436] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.266699] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.266960] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.267135] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.267253] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.267474] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.267615] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.267924] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1363.268032] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1363.268127] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1363.268231] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1363.268338] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1363.268439] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1363.268611] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1363.289511] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1363.289744] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1363.289916] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1363.290102] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-753" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.290404] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-3cd77ba1-5d3c-4400-85da-46242e9852c7 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.290573] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.290948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.290948] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.291082] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd77ba1-5d3c-4400-85da-46242e9852c7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.793912] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.794210] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.794403] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.794791] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.795086] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.795457] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.795695] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.795878] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.796207] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.796413] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.796822] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.797066] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.797248] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.797550] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.797752] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.797993] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 is going to be updated. [ 1363.821046] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.821356] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.821542] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.821911] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.822206] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.822527] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.962926] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.963045] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [req-a29e1166-1768-40b9-a8a9-7d3c6748df27 req-21d11966-e223-4155-ac19-0b0f5c30d78b service nova] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [req-a29e1166-1768-40b9-a8a9-7d3c6748df27 req-21d11966-e223-4155-ac19-0b0f5c30d78b service nova] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [req-a29e1166-1768-40b9-a8a9-7d3c6748df27 req-21d11966-e223-4155-ac19-0b0f5c30d78b service nova] Enqueued Resource ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 with Priority: HIGHEST for action port [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_rules [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1364.530813] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 with Priority: HIGHEST for action port [ 1364.530813] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.531967] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.532242] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.532554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.532753] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.534119] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.534387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.534554] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.534834] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.535102] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.535693] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.535874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.536149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.538757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.538757] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.538757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd77ba1-5d3c-4400-85da-46242e9852c7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.538757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.538757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.538757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.538757] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd77ba1-5d3c-4400-85da-46242e9852c7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.040817] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.040817] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.040817] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.041240] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cd77ba1-5d3c-4400-85da-46242e9852c7 with status ACTIVE [ 1365.041355] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.041468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.041542] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.044114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.044114] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.044114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.044114] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cd77ba1-5d3c-4400-85da-46242e9852c7 is going to be updated. [ 1365.066757] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.067357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.067357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.067357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.067357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.067540] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd77ba1-5d3c-4400-85da-46242e9852c7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.545044] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.047500] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.047682] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.047740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.048267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.048267] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.048267] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be updated. [ 1366.080511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.080757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.080757] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.080955] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.081115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.090307] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: IN_PROGRESS for 2s [ 1368.101485] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: SUCCESS [ 1368.101773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.101773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.101985] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.102198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.102323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.102390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.102551] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.102663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.102747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.102848] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.605622] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.108099] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecd15111-3c7c-4713-899a-8f4cf2bf2825: rpc.has_security_group_logging(os_id): False [ 1369.128528] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.128746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.128799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.128998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.129130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.129434] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.129546] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.129612] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.129800] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.129928] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.130059] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be updated. [ 1369.196737] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.196916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.196962] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.197197] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.197344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.211915] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: IN_PROGRESS for 2s [ 1369.528605] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.528732] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1370.401287] env[65222]: INFO networking_nsxv3.common.synchronization [None req-afcfaefc-1465-4bbe-80a5-e32b7126a139 None None] Enqueued Resource ID: 8e5d29d7-8064-4f35-825a-6d6a2702c1f2 with Priority: HIGHEST for action port [ 1370.401860] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5d29d7-8064-4f35-825a-6d6a2702c1f2 with Priority: HIGHEST for action port [ 1370.402135] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e5d29d7-8064-4f35-825a-6d6a2702c1f2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.402291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e5d29d7-8064-4f35-825a-6d6a2702c1f2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.402415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e5d29d7-8064-4f35-825a-6d6a2702c1f2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.402638] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e5d29d7-8064-4f35-825a-6d6a2702c1f2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.402698] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e5d29d7-8064-4f35-825a-6d6a2702c1f2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.727438] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4aa3094a-1ca3-47ba-9f1c-7d82d170ff25 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1370.728222] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1370.728795] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.728795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.728795] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.729051] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.729051] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.833074] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4fdddd30-2bf7-4b6e-8683-81a157e31f6a tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1370.833694] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1370.834018] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.834143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.906802] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e5d29d7-8064-4f35-825a-6d6a2702c1f2 [ 1370.907055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.907215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.907265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.907552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.907680] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.907792] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e5d29d7-8064-4f35-825a-6d6a2702c1f2 already deleted. [ 1370.907879] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e5d29d7-8064-4f35-825a-6d6a2702c1f2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.229944] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: SUCCESS [ 1371.229944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.252537] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.252815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.252815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.253314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.253314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.253478] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 already deleted. [ 1371.253556] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.253752] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.253986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.254132] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.780366] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.780744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.780744] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.780813] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.781697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.781697] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 already deleted. [ 1371.781697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.866056] env[65222]: INFO networking_nsxv3.common.synchronization [None req-6e6ffbf8-5e50-495d-9afe-0a45ca3dce47 None None] Enqueued Resource ID: 3c2ddf2b-76aa-4076-94d0-e09edb18ec1c with Priority: HIGHEST for action port [ 1372.866705] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2ddf2b-76aa-4076-94d0-e09edb18ec1c with Priority: HIGHEST for action port [ 1372.867190] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2ddf2b-76aa-4076-94d0-e09edb18ec1c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.867343] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2ddf2b-76aa-4076-94d0-e09edb18ec1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.867415] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2ddf2b-76aa-4076-94d0-e09edb18ec1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.867677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2ddf2b-76aa-4076-94d0-e09edb18ec1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.867760] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2ddf2b-76aa-4076-94d0-e09edb18ec1c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.369874] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c2ddf2b-76aa-4076-94d0-e09edb18ec1c [ 1373.370160] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.370324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.370412] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.370651] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.370746] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.370916] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c2ddf2b-76aa-4076-94d0-e09edb18ec1c already deleted. [ 1373.370997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2ddf2b-76aa-4076-94d0-e09edb18ec1c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.643712] env[65222]: INFO networking_nsxv3.common.synchronization [req-3db972d1-7e90-4437-8e24-7f10d1b788f0 req-0d26c19f-dc6c-4d3d-bd88-d6887fadf851 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1376.643712] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1376.643712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.643712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.643712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.643712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.643712] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.644972] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.645213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.645489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.645729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.645951] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.948233] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.948474] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.948625] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.949015] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.949440] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.949657] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.949786] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.950016] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.950171] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.950386] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1376.950489] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1376.950598] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1376.950713] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1376.950816] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1376.950919] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1376.951058] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1376.972386] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1376.972574] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1376.972677] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1376.972848] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.973176] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-51797e15-4839-4fd4-bf9c-393b99a5b6fa taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.973344] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.973466] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.973809] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.973947] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51797e15-4839-4fd4-bf9c-393b99a5b6fa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.150544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.150754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.150754] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.150960] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.151066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.151268] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.151365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.151428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.151574] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.151647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.151732] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 already deleted. [ 1377.151809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.476892] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.476892] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.476892] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.477222] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.477377] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.477555] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 51797e15-4839-4fd4-bf9c-393b99a5b6fa not found, creating... [ 1377.477824] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.477990] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.478112] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.478340] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.478472] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.478803] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.478989] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.479080] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.479283] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.479411] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.479549] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 51797e15-4839-4fd4-bf9c-393b99a5b6fa is going to be created. [ 1377.498516] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.498761] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.498814] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.499188] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.499443] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.499674] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.182647] env[65222]: INFO networking_nsxv3.common.synchronization [req-3db972d1-7e90-4437-8e24-7f10d1b788f0 req-71d4ada7-e630-412f-a4e9-f53d703c7720 service nova] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1378.182950] env[65222]: INFO networking_nsxv3.common.synchronization [req-3db972d1-7e90-4437-8e24-7f10d1b788f0 req-71d4ada7-e630-412f-a4e9-f53d703c7720 service nova] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1378.182950] env[65222]: INFO networking_nsxv3.common.synchronization [req-3db972d1-7e90-4437-8e24-7f10d1b788f0 req-71d4ada7-e630-412f-a4e9-f53d703c7720 service nova] Enqueued Resource ID: 51797e15-4839-4fd4-bf9c-393b99a5b6fa with Priority: HIGHEST for action port [ 1378.183503] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_rules [ 1378.183684] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1378.183815] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51797e15-4839-4fd4-bf9c-393b99a5b6fa with Priority: HIGHEST for action port [ 1378.184055] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.184179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.184247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.184444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.184522] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.185316] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.185634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.185634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.185634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.186496] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.186496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.186496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.186496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.186496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.186496] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.186970] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-51797e15-4839-4fd4-bf9c-393b99a5b6fa taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.187083] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.187146] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.187289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.187810] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51797e15-4839-4fd4-bf9c-393b99a5b6fa',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.689511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.689608] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.689776] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.690706] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51797e15-4839-4fd4-bf9c-393b99a5b6fa with status ACTIVE [ 1378.690896] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.691035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.691103] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.691325] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.691419] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.691705] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.691792] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.691846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.692027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.693255] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.693464] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.693601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.693724] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.693794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.693919] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.693965] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51797e15-4839-4fd4-bf9c-393b99a5b6fa is going to be updated. [ 1378.716716] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.716986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.716986] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.717186] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.717322] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.717487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51797e15-4839-4fd4-bf9c-393b99a5b6fa" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.195867] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.698414] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.698786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.698786] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.698866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.699013] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.699132] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 is going to be created. [ 1379.723031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.723031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.723031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.723031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.723031] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.732725] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: UNINITIALIZED for 2s [ 1381.744809] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: SUCCESS [ 1381.745208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.745208] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.745354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.745544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.745665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.745764] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.745931] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.746022] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.746112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.746205] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.248077] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.751082] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d27b3a0-2a60-448d-95ef-0e05c7817be5: rpc.has_security_group_logging(os_id): False [ 1382.771666] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.771887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.771887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.772088] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.772179] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.772416] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.772515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.772578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.772731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.772805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.772888] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 is going to be created. [ 1382.832045] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.832045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.832045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.832332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.832443] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.843798] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: IN_PROGRESS for 2s [ 1383.185279] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.185516] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1384.858037] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: SUCCESS [ 1384.858323] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.186480] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.186935] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.187707] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.188077] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.188699] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.189152] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.189823] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.190256] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.405016] env[65222]: INFO networking_nsxv3.common.synchronization [req-18517a0a-59cf-46e9-a441-b686e96d295f req-86e112b8-fcab-418a-b41d-321b47b0c5ab tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1403.405518] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1403.405827] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.405979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.406066] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.406362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.407530] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.407530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.407530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.407530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.407530] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.407530] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.908671] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.412053] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.914639] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.914870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.914870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.915025] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.915123] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.915224] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be updated. [ 1404.943964] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.944216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.944216] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.944401] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.944543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.953077] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1406.964891] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1406.965351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.406955] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.406955] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.407583] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.407954] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.993577] env[65222]: INFO networking_nsxv3.common.synchronization [req-9662fd6b-d5b0-4a8b-91a1-59a1d2a7f358 req-a8cb74b8-662a-43da-85e7-b9ceae7b2fb3 tempest-AttachVolumeShelveTestJSON-1497482084 tempest-AttachVolumeShelveTestJSON-1497482084-project-member] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1416.994199] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGHEST for action security_group_members [ 1416.994494] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.994616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.994717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.994873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.995031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.995130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.995194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.995391] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.995488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.995554] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.497979] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.498191] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.498321] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.498587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.498707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.498940] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.499092] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.499184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.500122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.500122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.500122] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be updated. [ 1417.529364] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.529581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.529581] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.529750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.529891] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.537867] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: IN_PROGRESS for 2s [ 1419.549905] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 in Status: SUCCESS [ 1419.550324] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 deletion is rescheduled due to dependency. [ 1419.550324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.668654] env[65222]: INFO networking_nsxv3.common.synchronization [req-13bac93a-671c-40e2-ac90-41fb08d27624 req-06172d7a-e0cc-4d50-8d84-dc5862804100 tempest-ServerActionsTestOtherA-843604766 tempest-ServerActionsTestOtherA-843604766-project-member] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1419.669296] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGHEST for action security_group_members [ 1419.669650] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.669773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.669863] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.670100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.670262] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.670623] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.670706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.670903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.670997] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.671119] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.173799] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.173941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.174062] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.174362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.174488] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.174720] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.174864] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.174950] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.175163] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.175261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.175373] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be updated. [ 1420.202667] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.202903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.202956] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.203218] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.203362] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.214232] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: IN_PROGRESS for 2s [ 1422.225147] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b27543c2-5369-4055-8e1e-f614903e057b in Status: SUCCESS [ 1422.225679] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b27543c2-5369-4055-8e1e-f614903e057b deletion is rescheduled due to dependency. [ 1422.225679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.670485] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.671395] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.672785] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.672785] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.673751] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.673751] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.992508] env[65222]: INFO networking_nsxv3.common.synchronization [None req-9a04343c-6a9d-4581-9748-601089a23400 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1434.993088] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1434.993428] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.993548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.993637] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.993901] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.994014] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.072740] env[65222]: INFO networking_nsxv3.common.synchronization [None req-4d6aaf4f-16c2-4485-9727-6abf20e1579a tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1435.073488] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1435.073794] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.073898] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.515341] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.515528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.515578] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.515760] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.515850] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.515947] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444a2839-5251-420a-906c-e30006c61b01 already deleted. [ 1435.516045] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.516193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.516387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.516479] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.037763] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.037763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.037763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.037763] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.038286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.038286] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444a2839-5251-420a-906c-e30006c61b01 already deleted. [ 1436.038286] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.074970] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.075331] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.397563] env[65222]: INFO networking_nsxv3.common.synchronization [req-c74bb650-c90d-4f28-883d-6d6012684d5a req-d055c7a0-1ec1-4f9a-bd9a-35be4597da8d tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1440.397563] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1440.397563] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.397563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.397563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.397563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.397940] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.397940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.397940] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.398138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.398138] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.398310] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.654513] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.654714] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.654838] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.655195] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.655498] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.655662] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.655820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.655998] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.656162] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.656462] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1440.656594] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1440.656704] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1440.656811] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1440.656929] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1440.657078] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1440.657244] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1440.678363] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1440.678599] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1440.678736] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1440.678908] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.679228] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-ff036387-e745-46e3-a511-5e669337e17d taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.679399] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.679505] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.679820] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.679956] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff036387-e745-46e3-a511-5e669337e17d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.900552] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.900877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.900877] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.900978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.901036] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.901231] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.901332] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.901390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.901552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.901624] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.901709] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444a2839-5251-420a-906c-e30006c61b01 already deleted. [ 1440.901788] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.182793] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.183326] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.183326] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.183495] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.183619] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.183774] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port ff036387-e745-46e3-a511-5e669337e17d not found, creating... [ 1441.184058] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.184233] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.184362] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.184629] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.184819] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.185281] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.185392] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.185545] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.185775] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.185912] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.186094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: ff036387-e745-46e3-a511-5e669337e17d is going to be created. [ 1441.207252] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.207483] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.207547] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.207835] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.208065] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.208291] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.883240] env[65222]: INFO networking_nsxv3.common.synchronization [req-c74bb650-c90d-4f28-883d-6d6012684d5a req-4f003e4d-7784-4e4d-a0ed-1ac53908015d service nova] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1441.883416] env[65222]: INFO networking_nsxv3.common.synchronization [req-c74bb650-c90d-4f28-883d-6d6012684d5a req-4f003e4d-7784-4e4d-a0ed-1ac53908015d service nova] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1441.883551] env[65222]: INFO networking_nsxv3.common.synchronization [req-c74bb650-c90d-4f28-883d-6d6012684d5a req-4f003e4d-7784-4e4d-a0ed-1ac53908015d service nova] Enqueued Resource ID: ff036387-e745-46e3-a511-5e669337e17d with Priority: HIGHEST for action port [ 1441.884084] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_rules [ 1441.884234] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1441.884344] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff036387-e745-46e3-a511-5e669337e17d with Priority: HIGHEST for action port [ 1441.884640] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.884748] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.884816] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.885116] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.885441] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.886089] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.886196] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.887029] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.887029] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.887400] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.887862] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff036387-e745-46e3-a511-5e669337e17d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.887995] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.888044] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.888193] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.888650] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff036387-e745-46e3-a511-5e669337e17d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.389964] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.391040] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.391118] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.391273] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff036387-e745-46e3-a511-5e669337e17d with status ACTIVE [ 1442.391433] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.391543] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.391601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.391802] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.391894] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.392075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.392183] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.392237] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.392381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.392466] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.392648] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.392739] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.392876] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.392929] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.392999] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.393094] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff036387-e745-46e3-a511-5e669337e17d is going to be updated. [ 1442.413767] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.413980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.413980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.414289] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.414427] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.414592] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff036387-e745-46e3-a511-5e669337e17d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.895325] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.397555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.397915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.397915] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.398024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.398153] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.398258] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444a2839-5251-420a-906c-e30006c61b01 is going to be created. [ 1443.423584] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.423737] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.423779] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.423992] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.424164] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.434065] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: UNINITIALIZED for 2s [ 1445.445032] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: SUCCESS [ 1445.445482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.445482] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.445582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.445750] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.445856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.445921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.446096] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.446177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.446271] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.446380] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.948403] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.451115] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 444a2839-5251-420a-906c-e30006c61b01: rpc.has_security_group_logging(os_id): False [ 1446.468402] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.468704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.468704] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.468860] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.468973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.469204] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.469305] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.469360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.469515] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.469588] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.469676] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444a2839-5251-420a-906c-e30006c61b01 is going to be created. [ 1446.526875] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.527127] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.527180] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.527416] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.527650] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.538114] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: IN_PROGRESS for 2s [ 1446.885133] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.885314] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1448.551125] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: SUCCESS [ 1448.551584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.885993] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.886367] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.886896] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.886896] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.888066] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.888468] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.889656] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.889656] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.890689] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.890689] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.891864] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.892361] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.893206] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.893593] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.893958] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.894303] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.353600] env[65222]: INFO networking_nsxv3.common.synchronization [req-b4470356-dda8-49d1-95b5-1b46cc6235ad req-fa79601b-1c93-4c7d-a60e-2f2b83c8ad6b tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1488.354167] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGHEST for action security_group_members [ 1488.354469] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.354589] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.354662] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.354924] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.355105] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.355219] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.355862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.355862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.355862] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.355862] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.857576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.857796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.857796] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.858115] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.858250] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.858474] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.858586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.858674] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.858847] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.858948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.859070] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444a2839-5251-420a-906c-e30006c61b01 is going to be updated. [ 1488.888788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.889054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.889110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.889353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.889523] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.897553] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: IN_PROGRESS for 2s [ 1490.911573] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444a2839-5251-420a-906c-e30006c61b01 in Status: SUCCESS [ 1490.911573] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444a2839-5251-420a-906c-e30006c61b01 deletion is rescheduled due to dependency. [ 1490.911573] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.022742] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1493.023122] env[65222]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de5f3ba6-4b88-4f31-98b5-6c5a741bf1df None None] NSXv3 Agent Agent loop - iteration:4 started [ 1493.354791] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.355037] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.355755] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.356193] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.853126] env[65222]: INFO networking_nsxv3.common.synchronization [req-1bfcb325-81d1-4132-863b-1509c4625fc6 req-2efe755b-223f-4bd8-ab46-75fc4e0780e0 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1499.853671] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGHEST for action security_group_members [ 1499.853976] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.854122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.854192] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.854390] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.854550] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.854649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.855024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.855024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.855024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.855261] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.357253] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.357463] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.357513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.357735] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.357828] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.358054] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.358157] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.358217] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.358364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.358439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.358524] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 is going to be updated. [ 1500.391504] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.391729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.391729] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.391897] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.392050] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.402971] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: IN_PROGRESS for 2s [ 1502.413443] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 in Status: SUCCESS [ 1502.413903] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 deletion is rescheduled due to dependency. [ 1502.413903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.569995] env[65222]: INFO networking_nsxv3.common.synchronization [None req-252569e0-ba28-4ec6-9326-049935afbd85 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1504.570610] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1504.570861] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.570984] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.571064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.571324] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.571405] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.654075] env[65222]: INFO networking_nsxv3.common.synchronization [None req-49ebf8bc-27f1-4b42-9909-3ee050f6c4e0 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1504.654452] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1504.654772] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.654899] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.093075] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.093236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.093308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.093531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.093621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.093717] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 already deleted. [ 1505.093799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.093948] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.094134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.094214] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.614490] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.614874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.614874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.614874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.614978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.615091] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 already deleted. [ 1505.615151] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.655448] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.655448] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.941543] env[65222]: INFO networking_nsxv3.common.synchronization [req-6d43880f-aa48-414f-a5be-5422dccc4b24 req-887fe848-8cc5-4d2b-90df-6cd7e8a564a0 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1509.942094] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1509.942395] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.942516] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.942582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.942831] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.942989] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.943107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.943167] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.943314] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.943417] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.943482] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.221818] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.222094] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.222389] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.222719] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.223423] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.223680] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.223822] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.224074] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.224222] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.224433] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1510.224575] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1510.224668] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1510.224764] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1510.224877] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1510.225016] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1510.225169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1510.246949] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1510.247185] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1510.247310] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1510.247488] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.247808] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-77dddc69-74ba-4af9-9d15-673eac88a87a taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.247992] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.248172] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.248514] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.248658] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77dddc69-74ba-4af9-9d15-673eac88a87a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.445630] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.445848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.445848] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.446042] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.446143] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.446345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.446446] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.446509] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.446664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.446740] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.446827] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 already deleted. [ 1510.446906] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.751487] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.751796] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.751966] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.752357] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.752551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.752742] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 77dddc69-74ba-4af9-9d15-673eac88a87a not found, creating... [ 1510.753074] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.753274] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.753412] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.753638] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.753774] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.754070] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.754230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.754346] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.754551] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.754685] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.754822] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 77dddc69-74ba-4af9-9d15-673eac88a87a is going to be created. [ 1510.777944] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.778297] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.778441] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.778719] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.778955] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.779184] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.451115] env[65222]: INFO networking_nsxv3.common.synchronization [req-6d43880f-aa48-414f-a5be-5422dccc4b24 req-9e76dfbb-2a9d-4bb8-b25a-d4e4738f0d0c service nova] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1511.451330] env[65222]: INFO networking_nsxv3.common.synchronization [req-6d43880f-aa48-414f-a5be-5422dccc4b24 req-9e76dfbb-2a9d-4bb8-b25a-d4e4738f0d0c service nova] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1511.451581] env[65222]: INFO networking_nsxv3.common.synchronization [req-6d43880f-aa48-414f-a5be-5422dccc4b24 req-9e76dfbb-2a9d-4bb8-b25a-d4e4738f0d0c service nova] Enqueued Resource ID: 77dddc69-74ba-4af9-9d15-673eac88a87a with Priority: HIGHEST for action port [ 1511.451792] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_rules [ 1511.451958] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1511.452115] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dddc69-74ba-4af9-9d15-673eac88a87a with Priority: HIGHEST for action port [ 1511.452759] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.452969] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.453378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.453378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.453378] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.454345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.454552] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.454641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.454874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.455198] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.455263] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.455366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.455596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.456410] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.456410] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.456910] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-77dddc69-74ba-4af9-9d15-673eac88a87a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.456910] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.457107] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.457264] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.457376] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77dddc69-74ba-4af9-9d15-673eac88a87a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.958990] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.959344] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.961467] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.962330] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77dddc69-74ba-4af9-9d15-673eac88a87a with status ACTIVE [ 1511.962519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.962648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.962716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.962896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.962987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.963180] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.963277] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.963339] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.963489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.963564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.963742] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.963830] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.963884] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.964035] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.964114] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.964199] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77dddc69-74ba-4af9-9d15-673eac88a87a is going to be updated. [ 1511.985078] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.985300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.985300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.985474] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.985605] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.985759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77dddc69-74ba-4af9-9d15-673eac88a87a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.465949] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.968031] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.968418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.968418] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.968495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.968613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.968710] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 is going to be created. [ 1512.993636] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.993887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.993887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.994064] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.994223] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.003483] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: UNINITIALIZED for 2s [ 1515.014690] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: SUCCESS [ 1515.015194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.015194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.015467] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.015727] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.015858] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.015934] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.016140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.016224] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.016313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.016404] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.518754] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.021630] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7a308f4-e676-483a-b0e4-c3f90165e3c5: rpc.has_security_group_logging(os_id): False [ 1516.040442] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.040633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.040633] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.040783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.040872] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.041136] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.041247] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.041291] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.041437] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.041511] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.041596] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 is going to be created. [ 1516.096624] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.096845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.096845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.097124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.097285] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.107308] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: IN_PROGRESS for 2s [ 1516.453432] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.453630] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1518.120398] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: SUCCESS [ 1518.120805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.454137] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.454543] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.455347] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.455347] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.964522] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.964964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.964964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.965134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.965134] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.467423] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.970338] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.456054] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.456237] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.472628] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1531.472804] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1532.198251] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.198712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.198712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.198712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.212152] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1532.212959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.213729] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1532.261541] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.261765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.261765] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.261943] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.276428] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.277266] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1532.277375] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.277474] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1532.309438] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.309679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.309679] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.309846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.310606] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.310765] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1532.412165] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.412383] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.412433] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.412622] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.412978] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.413341] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1532.511181] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.511426] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.511531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.511846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.512354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.512786] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:24. [ 1532.512948] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ecd15111-3c7c-4713-899a-8f4cf2bf2825', 'deb58d10-eb3b-46ea-87ea-d75bc77a65e2', 'b27543c2-5369-4055-8e1e-f614903e057b', '8e8b0390-6b22-4e1a-92fa-1046e5b93e83', 'bedc55f5-0ad2-4b84-aab1-d26ca6737e7a', '6355cca5-8c96-4bbb-bc95-01de745d5b8c', '4d27b3a0-2a60-448d-95ef-0e05c7817be5', 'f7a308f4-e676-483a-b0e4-c3f90165e3c5', '15ef4155-817c-4a1e-8484-6fde2baef247', '0d779a56-b08e-4d96-a298-035aff7f597c', '124a99d3-fe24-481b-88c5-184d5a1c99ee', '67a33950-b193-4a08-b38a-6d6532bafae7', 'afd30a92-4620-4e3f-a6da-5b25a5af9a83', '444a2839-5251-420a-906c-e30006c61b01', '4a1f130e-cc8b-4415-87be-b7a8cbdda189', '18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d', 'ccc4281e-6879-475e-a747-7907ebd40b7f', '6f6b2a52-a6df-4aec-9cd6-da7e43f26431', '3611c6f7-c786-4748-b4fa-faf7bcfceab1', '44afacd5-bc37-4272-9409-ec05ce0c00f8', 'a055c4f3-b6b2-41d3-9478-9a1e5a156588', 'a4c36af1-3224-4449-b91e-20d98bbff745', '2fbc24f1-8254-4b9b-9b11-d6605f74d8db', '3f9ca7bb-3383-460f-ae7e-f47b6d9ab4d3'} {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.513104] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1532.534544] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.534762] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.534887] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.535227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.535384] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.535563] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1532.535697] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.535841] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1532.609053] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.609300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.609300] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.609477] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.610626] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.610890] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1532.610970] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65222) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.611057] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1532.611126] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1532.611205] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/24 resources of Type:Security Group Rules [ 1532.611286] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGH for action security_group_rules [ 1532.611418] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1532.611505] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGH for action security_group_rules [ 1532.611570] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGH for action security_group_rules [ 1532.611632] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGH for action security_group_rules [ 1532.611697] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGH for action security_group_rules [ 1532.611757] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGH for action security_group_rules [ 1532.611861] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGH for action security_group_rules [ 1532.611902] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGH for action security_group_rules [ 1532.611941] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGH for action security_group_rules [ 1532.611979] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGH for action security_group_rules [ 1532.612052] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGH for action security_group_rules [ 1532.612114] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGH for action security_group_rules [ 1532.612176] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGH for action security_group_rules [ 1532.612237] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGH for action security_group_rules [ 1532.612298] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGH for action security_group_rules [ 1532.612359] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGH for action security_group_rules [ 1532.612420] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGH for action security_group_rules [ 1532.612482] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGH for action security_group_rules [ 1532.612542] env[65222]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGH for action security_group_rules [ 1532.612635] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.457598] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.457997] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1536.457997] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 with Priority: HIGH for action security_group_rules [ 1536.457997] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27543c2-5369-4055-8e1e-f614903e057b with Priority: HIGH for action security_group_rules [ 1536.458183] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 with Priority: HIGH for action security_group_rules [ 1536.458263] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 with Priority: HIGH for action security_group_rules [ 1536.458371] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 with Priority: HIGH for action security_group_rules [ 1536.458461] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 with Priority: HIGH for action security_group_rules [ 1536.458555] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 with Priority: HIGH for action security_group_rules [ 1536.458644] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc4281e-6879-475e-a747-7907ebd40b7f with Priority: HIGH for action security_group_rules [ 1536.458733] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444a2839-5251-420a-906c-e30006c61b01 with Priority: HIGH for action security_group_rules [ 1536.458819] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d with Priority: HIGH for action security_group_rules [ 1536.458904] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 with Priority: HIGH for action security_group_rules [ 1536.458991] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a33950-b193-4a08-b38a-6d6532bafae7 with Priority: HIGH for action security_group_rules [ 1536.459096] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee with Priority: HIGH for action security_group_rules [ 1536.459195] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d779a56-b08e-4d96-a298-035aff7f597c with Priority: HIGH for action security_group_rules [ 1536.459283] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ef4155-817c-4a1e-8484-6fde2baef247 with Priority: HIGH for action security_group_rules [ 1536.459371] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c with Priority: HIGH for action security_group_rules [ 1536.459457] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGH for action security_group_rules [ 1536.459540] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a with Priority: HIGH for action security_group_rules [ 1536.459679] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 with Priority: HIGH for action security_group_rules [ 1536.459829] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 with Priority: HIGH for action security_group_rules [ 1536.460226] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.460513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.460513] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.460671] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.460751] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecd15111-3c7c-4713-899a-8f4cf2bf2825',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.461723] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b27543c2-5369-4055-8e1e-f614903e057b taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.461902] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.461973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.462159] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.462257] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b27543c2-5369-4055-8e1e-f614903e057b',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.463307] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.463439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.463504] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.463789] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.463789] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d27b3a0-2a60-448d-95ef-0e05c7817be5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.464410] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.464521] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.464582] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.464713] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.464775] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f130e-cc8b-4415-87be-b7a8cbdda189',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.465463] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44afacd5-bc37-4272-9409-ec05ce0c00f8 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.465575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.465643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.465958] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.465958] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44afacd5-bc37-4272-9409-ec05ce0c00f8',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.466513] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.466616] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.466678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.466824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.466894] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3611c6f7-c786-4748-b4fa-faf7bcfceab1',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.469403] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.469510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.469587] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.469747] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.469819] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6b2a52-a6df-4aec-9cd6-da7e43f26431',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.470477] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccc4281e-6879-475e-a747-7907ebd40b7f taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.470584] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.470649] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.470794] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.470864] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccc4281e-6879-475e-a747-7907ebd40b7f',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.471543] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444a2839-5251-420a-906c-e30006c61b01 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.471613] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.471677] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.471822] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.471892] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444a2839-5251-420a-906c-e30006c61b01',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.472535] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.472642] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.472710] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.472856] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.472923] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.608477] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.608712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.608712] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.608815] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.608883] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd30a92-4620-4e3f-a6da-5b25a5af9a83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.609734] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67a33950-b193-4a08-b38a-6d6532bafae7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.609838] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.609900] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.610080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.610156] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67a33950-b193-4a08-b38a-6d6532bafae7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.610870] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-124a99d3-fe24-481b-88c5-184d5a1c99ee taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.610979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.611040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.611187] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.611259] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('124a99d3-fe24-481b-88c5-184d5a1c99ee',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.611999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d779a56-b08e-4d96-a298-035aff7f597c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.612110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.612178] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.612367] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.612409] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d779a56-b08e-4d96-a298-035aff7f597c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.613821] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15ef4155-817c-4a1e-8484-6fde2baef247 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.613821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.613821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.613821] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.613821] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15ef4155-817c-4a1e-8484-6fde2baef247',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.614117] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.614177] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.614215] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.614364] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.614432] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6355cca5-8c96-4bbb-bc95-01de745d5b8c',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.615170] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.615319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.615379] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.615487] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.615558] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.616227] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.616334] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.616400] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.616547] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.616617] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bedc55f5-0ad2-4b84-aab1-d26ca6737e7a',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.617304] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.617444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.617444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.617601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.617670] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deb58d10-eb3b-46ea-87ea-d75bc77a65e2',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.618398] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.618495] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.618559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.618701] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.618771] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8b0390-6b22-4e1a-92fa-1046e5b93e83',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.671193] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.671501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.671501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.671676] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.673278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.673430] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.674091] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.674233] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.674854] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.674979] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.675632] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.675750] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.676401] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.676533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.677210] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.677350] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.677995] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.678134] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.695148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.695297] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccc4281e-6879-475e-a747-7907ebd40b7f is going to be deleted. [ 1536.696110] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.696303] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.721564] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.721723] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d is going to be deleted. [ 1536.722520] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.722716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.744378] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.744573] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecd15111-3c7c-4713-899a-8f4cf2bf2825 is going to be deleted. [ 1536.745479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.745697] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.786824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.787027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.787678] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.787766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.789559] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.789676] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd30a92-4620-4e3f-a6da-5b25a5af9a83 is going to be deleted. [ 1536.790528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.790734] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.808897] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.809124] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.809975] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.810113] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44afacd5-bc37-4272-9409-ec05ce0c00f8 is going to be deleted. [ 1536.810964] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.811182] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.835436] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.835622] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6b2a52-a6df-4aec-9cd6-da7e43f26431 is going to be deleted. [ 1536.836489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.836709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.888284] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.888522] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.898759] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.898932] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b27543c2-5369-4055-8e1e-f614903e057b is going to be deleted. [ 1536.899892] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.900130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.937407] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.937644] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.939953] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.940102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f130e-cc8b-4415-87be-b7a8cbdda189 is going to be deleted. [ 1536.941024] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.941253] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.941347] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.941468] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccc4281e-6879-475e-a747-7907ebd40b7f" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.941621] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.941778] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.941849] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.941961] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18cccc8e-ab87-4e53-b4c1-cd1227cf7f4d" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.942498] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.942656] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.942736] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.942853] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecd15111-3c7c-4713-899a-8f4cf2bf2825" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.942982] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.943149] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.943236] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.943328] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd30a92-4620-4e3f-a6da-5b25a5af9a83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.943460] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.943596] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.943665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.943771] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44afacd5-bc37-4272-9409-ec05ce0c00f8" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.950485] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.950634] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.950675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.950825] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.950904] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.951027] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6b2a52-a6df-4aec-9cd6-da7e43f26431" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.028356] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.028619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.028619] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.028766] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.028854] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.028974] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b27543c2-5369-4055-8e1e-f614903e057b" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.126130] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.126359] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.126420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.126700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.126936] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.127089] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.127181] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.127420] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.127531] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.127652] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.127778] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.147997] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.148207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.148207] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.148459] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.148557] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.148700] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f130e-cc8b-4415-87be-b7a8cbdda189" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.176702] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.176951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.176951] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.177148] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.178880] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.179041] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.179748] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.179845] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.180507] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.180603] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.181261] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.181354] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.182333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.182333] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.182917] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.183140] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.183851] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.183944] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.184651] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.184783] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.185383] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.185478] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.186396] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1537.186894] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.187009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.230642] env[65222]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1537.231319] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.232942] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15ef4155-817c-4a1e-8484-6fde2baef247 is going to be deleted. [ 1537.232942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.232942] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.282472] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.282643] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6355cca5-8c96-4bbb-bc95-01de745d5b8c is going to be deleted. [ 1537.283489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.283707] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.302365] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.302574] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d779a56-b08e-4d96-a298-035aff7f597c is going to be deleted. [ 1537.303510] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.303725] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.327575] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.327771] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444a2839-5251-420a-906c-e30006c61b01 is going to be deleted. [ 1537.328731] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.328945] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.330405] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.330528] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.350085] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.350297] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.350937] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.351054] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.351914] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.352044] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67a33950-b193-4a08-b38a-6d6532bafae7 is going to be deleted. [ 1537.352896] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.353122] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.401213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.401399] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deb58d10-eb3b-46ea-87ea-d75bc77a65e2 is going to be deleted. [ 1537.402377] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.402602] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.424288] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.424501] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.460605] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.460998] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.464259] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.464427] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 124a99d3-fe24-481b-88c5-184d5a1c99ee is going to be deleted. [ 1537.465299] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.465548] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.494865] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.495067] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8b0390-6b22-4e1a-92fa-1046e5b93e83 is going to be deleted. [ 1537.496026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.496265] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.566846] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.567044] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bedc55f5-0ad2-4b84-aab1-d26ca6737e7a is going to be deleted. [ 1537.567963] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.568194] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.580839] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.581112] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.594720] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.594976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.602675] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.602879] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3611c6f7-c786-4748-b4fa-faf7bcfceab1 is going to be deleted. [ 1537.603770] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.603980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.634905] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.663733] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.663967] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d27b3a0-2a60-448d-95ef-0e05c7817be5 is going to be deleted. [ 1537.664805] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.665026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.665102] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.665234] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15ef4155-817c-4a1e-8484-6fde2baef247" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.665407] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.665567] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.665641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.665751] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d779a56-b08e-4d96-a298-035aff7f597c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.666316] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.666475] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.666568] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.666706] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6355cca5-8c96-4bbb-bc95-01de745d5b8c" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.666840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.667033] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.667130] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.667222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444a2839-5251-420a-906c-e30006c61b01" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.667387] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.667533] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.667600] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.667716] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67a33950-b193-4a08-b38a-6d6532bafae7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.667840] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.667976] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.668048] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.668165] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deb58d10-eb3b-46ea-87ea-d75bc77a65e2" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.668320] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.668489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.668555] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.668663] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-124a99d3-fe24-481b-88c5-184d5a1c99ee" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.669519] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.669694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.669694] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.669851] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.670017] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.670075] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8b0390-6b22-4e1a-92fa-1046e5b93e83" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.703555] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.703787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.703787] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.703973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.704081] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.704205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bedc55f5-0ad2-4b84-aab1-d26ca6737e7a" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.709613] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.709797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.709866] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.710039] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.710129] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.710245] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3611c6f7-c786-4748-b4fa-faf7bcfceab1" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.819576] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.819798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.819798] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.819980] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.820085] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.820213] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d27b3a0-2a60-448d-95ef-0e05c7817be5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.137838] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7a308f4-e676-483a-b0e4-c3f90165e3c5: rpc.has_security_group_logging(os_id): False [ 1538.155377] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.155641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.155641] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.155791] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.175666] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.175999] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.176137] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.176200] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.176404] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.176489] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.176581] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 is going to be updated. [ 1538.240028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.240317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.240317] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.240458] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.240601] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.256169] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: IN_PROGRESS for 2s [ 1540.271121] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: SUCCESS [ 1540.271643] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.460502] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.460873] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.462331] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.462331] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.463655] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.464100] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.465642] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.466213] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.466855] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.467155] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.468398] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.468811] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.469405] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.469778] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.585253] env[65222]: INFO networking_nsxv3.common.synchronization [req-078c1356-a035-4480-8421-0dc61c5052bd req-d260fb6b-0773-448c-99f4-546d83d34a45 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1573.585943] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 with Priority: HIGHEST for action security_group_members [ 1573.586788] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7a308f4-e676-483a-b0e4-c3f90165e3c5 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.586941] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.587078] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.587184] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.587345] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.587445] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.587508] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.587883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.587883] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.587883] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7a308f4-e676-483a-b0e4-c3f90165e3c5',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.091097] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.091097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.091097] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.091396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.091439] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.091610] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.091709] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.091769] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.091916] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.091990] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.092090] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 is going to be updated. [ 1574.122278] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.122496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.122496] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.122664] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.122806] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.131357] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: IN_PROGRESS for 2s [ 1576.142918] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 in Status: SUCCESS [ 1576.143372] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7a308f4-e676-483a-b0e4-c3f90165e3c5 deletion is rescheduled due to dependency. [ 1576.143372] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7a308f4-e676-483a-b0e4-c3f90165e3c5" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.293114] env[65222]: INFO networking_nsxv3.common.synchronization [None req-b52fe3d6-8b80-4e85-803c-0d198aef8fb6 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1578.293618] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1578.293913] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.294046] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.294128] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.294366] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.294446] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.369990] env[65222]: INFO networking_nsxv3.common.synchronization [None req-08c37aef-34b2-474b-8580-a96dd22821bf tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1578.370444] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1578.370740] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.370841] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.814806] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.814959] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.815047] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.815261] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.815351] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.815452] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636228b9-54e6-4997-930f-83842f579ca7 already deleted. [ 1578.815535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.815720] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.815882] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.815967] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.336034] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.336034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.336034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.336034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.336034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.336034] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636228b9-54e6-4997-930f-83842f579ca7 already deleted. [ 1579.336034] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.370995] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.371314] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.646456] env[65222]: INFO networking_nsxv3.common.synchronization [req-3715664e-da04-4dad-9798-67765285633d req-73b88f26-ea6d-49cb-a9b8-089ecfc7e997 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1583.646959] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1583.647303] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.647425] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.647500] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.647809] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.647973] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.648100] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.648171] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.648308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.648422] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.648548] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.939013] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.939230] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.939351] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.939612] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.939867] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.940033] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.940147] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.940353] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.940509] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.940735] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1583.940846] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] NeedRegenerationException {{(pid=65222) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1583.940950] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] no value, waiting for create lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1583.941065] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] value creation lock acquired {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1583.941171] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] No value present for key: 'zone-id' {{(pid=65222) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1583.941271] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Calling creation function for not-yet-present value {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1583.941398] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1583.962401] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1583.962571] env[65222]: DEBUG dogpile.cache.region [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65222) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1583.962683] env[65222]: DEBUG dogpile.lock [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Released creation lock {{(pid=65222) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1583.962855] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "network-201" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.963178] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock port-67c3e60b-f880-47f0-950b-d7edef3c1125 taken with stack trace [, , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.963347] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.963464] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.963794] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.963927] env[65222]: DEBUG networking_nsxv3.api.rpc [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c3e60b-f880-47f0-950b-d7edef3c1125',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.150558] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.150773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.150773] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.150973] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.151077] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.151283] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.151381] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.151440] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.151591] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.151665] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.151751] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636228b9-54e6-4997-930f-83842f579ca7 already deleted. [ 1584.151833] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.466165] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.466548] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.466548] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.466785] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.466938] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.467102] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Segment Port 67c3e60b-f880-47f0-950b-d7edef3c1125 not found, creating... [ 1584.467362] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.467516] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.467627] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.467883] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.468026] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.468304] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.468453] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.468610] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.468785] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.468968] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.469103] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Resource: SegmentPort with ID: 67c3e60b-f880-47f0-950b-d7edef3c1125 is going to be created. [ 1584.488678] env[65222]: DEBUG networking_nsxv3.common.locking [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.488901] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.489069] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.489408] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.489726] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.490052] env[65222]: DEBUG oslo_concurrency.lockutils [None req-019f5054-9273-44f1-ad07-a2b66423da48 None None] Releasing lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.182489] env[65222]: INFO networking_nsxv3.common.synchronization [req-3715664e-da04-4dad-9798-67765285633d req-8a5ac91f-572d-44da-ba53-96aba3ae37da service nova] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1585.182778] env[65222]: INFO networking_nsxv3.common.synchronization [req-3715664e-da04-4dad-9798-67765285633d req-8a5ac91f-572d-44da-ba53-96aba3ae37da service nova] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1585.182903] env[65222]: INFO networking_nsxv3.common.synchronization [req-3715664e-da04-4dad-9798-67765285633d req-8a5ac91f-572d-44da-ba53-96aba3ae37da service nova] Enqueued Resource ID: 67c3e60b-f880-47f0-950b-d7edef3c1125 with Priority: HIGHEST for action port [ 1585.183325] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_rules [ 1585.183463] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1585.183557] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c3e60b-f880-47f0-950b-d7edef3c1125 with Priority: HIGHEST for action port [ 1585.183824] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.183946] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.184139] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.184363] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.184447] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.185996] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.186120] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.186170] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.187028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.187028] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.187028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.187028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.187028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.187028] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.187028] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.187670] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock port-67c3e60b-f880-47f0-950b-d7edef3c1125 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.187799] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.187870] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.188040] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.188110] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c3e60b-f880-47f0-950b-d7edef3c1125',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.687333] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.687758] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.689772] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.690638] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67c3e60b-f880-47f0-950b-d7edef3c1125 with status ACTIVE [ 1585.690819] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.690937] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.691009] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.691225] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.691313] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.691489] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.691586] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.691647] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.691797] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.691874] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.692068] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.692161] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.692222] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.692360] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.692432] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.692531] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67c3e60b-f880-47f0-950b-d7edef3c1125 is going to be updated. [ 1585.712309] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.712524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.712524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.712678] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.712812] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.712966] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67c3e60b-f880-47f0-950b-d7edef3c1125" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.194306] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.696511] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.696873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.696873] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.697026] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.697080] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.697158] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636228b9-54e6-4997-930f-83842f579ca7 is going to be created. [ 1586.724638] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.724859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.724859] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.725052] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.725206] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.735236] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: UNINITIALIZED for 2s [ 1588.746034] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: SUCCESS [ 1588.746357] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.746454] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.746668] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.746863] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.746987] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.747067] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.747227] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.747308] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.747402] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.747489] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.250253] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.752903] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 636228b9-54e6-4997-930f-83842f579ca7: rpc.has_security_group_logging(os_id): False [ 1589.770972] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.771199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.771199] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.771424] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.771517] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.771796] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.771903] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.771965] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.772135] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.772205] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.772292] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636228b9-54e6-4997-930f-83842f579ca7 is going to be created. [ 1589.829234] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.829479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.829479] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.829648] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.829827] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.841162] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: IN_PROGRESS for 2s [ 1590.184756] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.184756] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1591.854975] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: SUCCESS [ 1591.855396] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.185757] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.186161] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1600.187258] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1600.187649] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1605.188637] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1605.189053] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.189951] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1610.192142] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1615.190930] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.191337] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.192551] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.193033] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.193832] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.194278] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.194796] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.195211] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.196490] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.196924] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.198052] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.198492] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.261160] env[65222]: INFO networking_nsxv3.common.synchronization [req-e207afd9-e017-41df-bf5c-f402cee76917 req-36f178e5-88a6-423b-8b3e-0155b082dbb4 tempest-AttachVolumeNegativeTest-662817035 tempest-AttachVolumeNegativeTest-662817035-project-member] Enqueued Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1644.261963] env[65222]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636228b9-54e6-4997-930f-83842f579ca7 with Priority: HIGHEST for action security_group_members [ 1644.262380] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock member-636228b9-54e6-4997-930f-83842f579ca7 taken with stack trace [, , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.262563] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.262667] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.262913] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.263088] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.263353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.263353] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.263444] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.263535] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.263571] env[65222]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636228b9-54e6-4997-930f-83842f579ca7',) {} {{(pid=65222) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1644.766321] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.766585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.766585] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.766824] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.766921] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.767151] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.767244] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.767302] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.767453] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.767524] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.767609] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636228b9-54e6-4997-930f-83842f579ca7 is going to be updated. [ 1644.805159] env[65222]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.805397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.805397] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.805545] env[65222]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.805681] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.814460] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: IN_PROGRESS for 2s [ 1646.825312] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636228b9-54e6-4997-930f-83842f579ca7 in Status: SUCCESS [ 1646.825717] env[65222]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636228b9-54e6-4997-930f-83842f579ca7 deletion is rescheduled due to dependency. [ 1646.825717] env[65222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636228b9-54e6-4997-930f-83842f579ca7" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1649.262679] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.263140] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.263384] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.263792] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1659.264169] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.264169] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.265323] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.265748] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.266393] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.266790] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.268012] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1674.268012] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1679.269456] env[65222]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1679.269974] env[65222]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0